2026-02-17T08:07:35.012 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T08:07:35.028 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:07:35.110 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51105 branch: wip-bharath19-testing-2026-02-13-0903-squid description: rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '51105' kernel: branch: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-bharath19-testing-2026-02-13-0903-squid ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e workunit: branch: wip-bharath19-testing-2026-02-13-0903-squid sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 3603 sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath19-testing-2026-02-13-0903-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e targets: trial059.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCyA5IEdciI3HvVhfYVa+ivHnPZnrlwkQuQO5CLvVMpBj+XJnoSD+FLrFHME7IPcpK0j9BD9UUMSwTKaNPtxpRE= tasks: - install: null - workunit: basedir: qa/standalone clients: all: - erasure-code teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_04:03:08 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T08:07:35.110 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa; will attempt to use it 2026-02-17T08:07:35.110 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks 2026-02-17T08:07:35.110 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T08:07:35.112 INFO:teuthology.task.internal:Checking packages... 2026-02-17T08:07:35.112 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e' 2026-02-17T08:07:35.112 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T08:07:35.112 INFO:teuthology.packaging:ref: None 2026-02-17T08:07:35.112 INFO:teuthology.packaging:tag: None 2026-02-17T08:07:35.112 INFO:teuthology.packaging:branch: wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T08:07:35.112 INFO:teuthology.packaging:sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:07:35.112 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T08:07:35.227 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-705-g04cf6dd4-1jammy 2026-02-17T08:07:35.228 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T08:07:35.238 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T08:07:35.238 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T08:07:35.250 INFO:teuthology.task.internal:Saving configuration 2026-02-17T08:07:35.257 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T08:07:35.270 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T08:07:35.347 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial059.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51105', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 08:04:06.512444', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINncx+sHJHeqw9JV9ueFOiptmUsQo8G88K/MLHIlS2Mz'} 2026-02-17T08:07:35.348 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T08:07:35.359 INFO:teuthology.task.internal:roles: ubuntu@trial059.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-17T08:07:35.359 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T08:07:35.443 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7acdface7d80>, signals=[15]) 2026-02-17T08:07:35.443 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T08:07:35.460 INFO:teuthology.task.internal:Opening connections... 2026-02-17T08:07:35.460 DEBUG:teuthology.task.internal:connecting to ubuntu@trial059.front.sepia.ceph.com 2026-02-17T08:07:35.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:07:35.525 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T08:07:35.536 DEBUG:teuthology.orchestra.run.trial059:> uname -m 2026-02-17T08:07:35.603 INFO:teuthology.orchestra.run.trial059.stdout:x86_64 2026-02-17T08:07:35.603 DEBUG:teuthology.orchestra.run.trial059:> cat /etc/os-release 2026-02-17T08:07:35.650 INFO:teuthology.orchestra.run.trial059.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-17T08:07:35.650 INFO:teuthology.orchestra.run.trial059.stdout:NAME="Ubuntu" 2026-02-17T08:07:35.650 INFO:teuthology.orchestra.run.trial059.stdout:VERSION_ID="22.04" 2026-02-17T08:07:35.650 INFO:teuthology.orchestra.run.trial059.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-17T08:07:35.651 INFO:teuthology.orchestra.run.trial059.stdout:VERSION_CODENAME=jammy 2026-02-17T08:07:35.651 INFO:teuthology.orchestra.run.trial059.stdout:ID=ubuntu 2026-02-17T08:07:35.651 INFO:teuthology.orchestra.run.trial059.stdout:ID_LIKE=debian 2026-02-17T08:07:35.651 INFO:teuthology.orchestra.run.trial059.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-17T08:07:35.651 INFO:teuthology.orchestra.run.trial059.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-17T08:07:35.651 INFO:teuthology.orchestra.run.trial059.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-17T08:07:35.651 INFO:teuthology.orchestra.run.trial059.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-17T08:07:35.651 INFO:teuthology.orchestra.run.trial059.stdout:UBUNTU_CODENAME=jammy 2026-02-17T08:07:35.652 INFO:teuthology.lock.ops:Updating trial059.front.sepia.ceph.com on lock server 2026-02-17T08:07:35.743 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T08:07:35.755 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T08:07:35.769 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T08:07:35.769 DEBUG:teuthology.orchestra.run.trial059:> test '!' -e /home/ubuntu/cephtest 2026-02-17T08:07:35.773 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T08:07:35.786 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T08:07:35.786 DEBUG:teuthology.orchestra.run.trial059:> test -z $(ls -A /var/lib/ceph) 2026-02-17T08:07:35.820 INFO:teuthology.orchestra.run.trial059.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-17T08:07:35.821 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T08:07:35.924 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T08:07:35.944 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T08:07:35.944 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T08:07:35.944 DEBUG:teuthology.orchestra.run.trial059:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T08:07:35.947 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:07:35.947 DEBUG:teuthology.orchestra.run.trial059:> uname -r 2026-02-17T08:07:35.998 INFO:teuthology.orchestra.run.trial059.stdout:5.15.0-164-generic 2026-02-17T08:07:35.998 INFO:teuthology.task.kernel:Running kernel on trial059: 5.15.0-164-generic 2026-02-17T08:07:35.999 DEBUG:teuthology.orchestra.run.trial059:> sudo apt-get clean 2026-02-17T08:07:36.056 DEBUG:teuthology.orchestra.run.trial059:> sudo apt-get update 2026-02-17T08:07:36.249 INFO:teuthology.orchestra.run.trial059.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T08:07:36.257 INFO:teuthology.orchestra.run.trial059.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-17T08:07:36.295 INFO:teuthology.orchestra.run.trial059.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-17T08:07:36.311 INFO:teuthology.orchestra.run.trial059.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-17T08:07:36.388 INFO:teuthology.orchestra.run.trial059.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3237 kB] 2026-02-17T08:07:36.455 INFO:teuthology.orchestra.run.trial059.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [493 kB] 2026-02-17T08:07:36.458 INFO:teuthology.orchestra.run.trial059.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-17T08:07:36.459 INFO:teuthology.orchestra.run.trial059.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1255 kB] 2026-02-17T08:07:36.469 INFO:teuthology.orchestra.run.trial059.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [313 kB] 2026-02-17T08:07:36.471 INFO:teuthology.orchestra.run.trial059.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-17T08:07:36.472 INFO:teuthology.orchestra.run.trial059.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5287 kB] 2026-02-17T08:07:36.500 INFO:teuthology.orchestra.run.trial059.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [997 kB] 2026-02-17T08:07:36.502 INFO:teuthology.orchestra.run.trial059.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2966 kB] 2026-02-17T08:07:36.512 INFO:teuthology.orchestra.run.trial059.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [426 kB] 2026-02-17T08:07:36.513 INFO:teuthology.orchestra.run.trial059.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-17T08:07:36.513 INFO:teuthology.orchestra.run.trial059.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1017 kB] 2026-02-17T08:07:36.517 INFO:teuthology.orchestra.run.trial059.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [224 kB] 2026-02-17T08:07:36.518 INFO:teuthology.orchestra.run.trial059.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.6 kB] 2026-02-17T08:07:36.518 INFO:teuthology.orchestra.run.trial059.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5096 kB] 2026-02-17T08:07:36.538 INFO:teuthology.orchestra.run.trial059.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [964 kB] 2026-02-17T08:07:40.240 INFO:teuthology.orchestra.run.trial059.stdout:Fetched 22.7 MB in 2s (13.4 MB/s) 2026-02-17T08:07:40.765 INFO:teuthology.orchestra.run.trial059.stdout:Reading package lists... 2026-02-17T08:07:40.778 DEBUG:teuthology.orchestra.run.trial059:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-17T08:07:40.811 INFO:teuthology.orchestra.run.trial059.stdout:Reading package lists... 2026-02-17T08:07:40.919 INFO:teuthology.orchestra.run.trial059.stdout:Building dependency tree... 2026-02-17T08:07:40.920 INFO:teuthology.orchestra.run.trial059.stdout:Reading state information... 2026-02-17T08:07:41.007 INFO:teuthology.orchestra.run.trial059.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T08:07:41.007 INFO:teuthology.orchestra.run.trial059.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T08:07:41.008 INFO:teuthology.orchestra.run.trial059.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T08:07:41.008 INFO:teuthology.orchestra.run.trial059.stdout: sg3-utils-udev 2026-02-17T08:07:41.008 INFO:teuthology.orchestra.run.trial059.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T08:07:41.008 INFO:teuthology.orchestra.run.trial059.stdout:The following additional packages will be installed: 2026-02-17T08:07:41.008 INFO:teuthology.orchestra.run.trial059.stdout: linux-generic linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-17T08:07:41.008 INFO:teuthology.orchestra.run.trial059.stdout: linux-headers-generic linux-image-5.15.0-170-generic 2026-02-17T08:07:41.008 INFO:teuthology.orchestra.run.trial059.stdout: linux-modules-5.15.0-170-generic linux-modules-extra-5.15.0-170-generic 2026-02-17T08:07:41.008 INFO:teuthology.orchestra.run.trial059.stdout:Suggested packages: 2026-02-17T08:07:41.008 INFO:teuthology.orchestra.run.trial059.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-17T08:07:41.021 INFO:teuthology.orchestra.run.trial059.stdout:The following NEW packages will be installed: 2026-02-17T08:07:41.021 INFO:teuthology.orchestra.run.trial059.stdout: linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-17T08:07:41.022 INFO:teuthology.orchestra.run.trial059.stdout: linux-image-5.15.0-170-generic linux-modules-5.15.0-170-generic 2026-02-17T08:07:41.022 INFO:teuthology.orchestra.run.trial059.stdout: linux-modules-extra-5.15.0-170-generic 2026-02-17T08:07:41.022 INFO:teuthology.orchestra.run.trial059.stdout:The following packages will be upgraded: 2026-02-17T08:07:41.022 INFO:teuthology.orchestra.run.trial059.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-17T08:07:41.519 INFO:teuthology.orchestra.run.trial059.stdout:3 upgraded, 5 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T08:07:41.519 INFO:teuthology.orchestra.run.trial059.stdout:Need to get 113 MB of archives. 2026-02-17T08:07:41.519 INFO:teuthology.orchestra.run.trial059.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-17T08:07:41.520 INFO:teuthology.orchestra.run.trial059.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-170-generic amd64 5.15.0-170.180 [22.7 MB] 2026-02-17T08:07:42.872 INFO:teuthology.orchestra.run.trial059.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-170-generic amd64 5.15.0-170.180 [11.6 MB] 2026-02-17T08:07:43.202 INFO:teuthology.orchestra.run.trial059.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-170-generic amd64 5.15.0-170.180 [64.0 MB] 2026-02-17T08:07:45.233 INFO:teuthology.orchestra.run.trial059.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.170.159 [1654 B] 2026-02-17T08:07:45.233 INFO:teuthology.orchestra.run.trial059.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.170.159 [2474 B] 2026-02-17T08:07:45.233 INFO:teuthology.orchestra.run.trial059.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170 all 5.15.0-170.180 [12.4 MB] 2026-02-17T08:07:45.603 INFO:teuthology.orchestra.run.trial059.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170-generic amd64 5.15.0-170.180 [2828 kB] 2026-02-17T08:07:45.696 INFO:teuthology.orchestra.run.trial059.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.170.159 [2316 B] 2026-02-17T08:07:45.893 INFO:teuthology.orchestra.run.trial059.stdout:Fetched 113 MB in 5s (24.3 MB/s) 2026-02-17T08:07:45.914 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package linux-modules-5.15.0-170-generic. 2026-02-17T08:07:46.080 INFO:teuthology.orchestra.run.trial059.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 131954 files and directories currently installed.) 2026-02-17T08:07:46.081 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../0-linux-modules-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T08:07:46.083 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:07:46.434 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package linux-image-5.15.0-170-generic. 2026-02-17T08:07:46.440 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../1-linux-image-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T08:07:46.461 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:07:46.502 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-170-generic. 2026-02-17T08:07:46.509 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T08:07:46.509 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:07:47.608 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../3-linux-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T08:07:47.609 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking linux-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T08:07:47.631 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T08:07:47.633 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking linux-image-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T08:07:47.651 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package linux-headers-5.15.0-170. 2026-02-17T08:07:47.658 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../5-linux-headers-5.15.0-170_5.15.0-170.180_all.deb ... 2026-02-17T08:07:47.658 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-17T08:07:49.025 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package linux-headers-5.15.0-170-generic. 2026-02-17T08:07:49.037 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../6-linux-headers-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T08:07:49.037 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:07:49.621 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T08:07:49.621 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking linux-headers-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T08:07:49.647 INFO:teuthology.orchestra.run.trial059.stdout:Setting up linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-17T08:07:49.647 INFO:teuthology.orchestra.run.trial059.stdout:Setting up linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:07:49.649 INFO:teuthology.orchestra.run.trial059.stdout:Setting up linux-headers-generic (5.15.0.170.159) ... 2026-02-17T08:07:49.650 INFO:teuthology.orchestra.run.trial059.stdout:Setting up linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:07:50.412 INFO:teuthology.orchestra.run.trial059.stdout:Setting up linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:07:51.234 INFO:teuthology.orchestra.run.trial059.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-17T08:07:51.235 INFO:teuthology.orchestra.run.trial059.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-170-generic 2026-02-17T08:07:51.241 INFO:teuthology.orchestra.run.trial059.stdout:Setting up linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:07:52.031 INFO:teuthology.orchestra.run.trial059.stdout:Setting up linux-image-generic (5.15.0.170.159) ... 2026-02-17T08:07:52.032 INFO:teuthology.orchestra.run.trial059.stdout:Setting up linux-generic (5.15.0.170.159) ... 2026-02-17T08:07:52.033 INFO:teuthology.orchestra.run.trial059.stdout:Processing triggers for linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:07:52.038 INFO:teuthology.orchestra.run.trial059.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-17T08:07:52.038 INFO:teuthology.orchestra.run.trial059.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-170-generic 2026-02-17T08:07:59.111 INFO:teuthology.orchestra.run.trial059.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-17T08:08:05.722 INFO:teuthology.orchestra.run.trial059.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-17T08:08:05.722 INFO:teuthology.orchestra.run.trial059.stdout:Sourcing file `/etc/default/grub' 2026-02-17T08:08:05.741 INFO:teuthology.orchestra.run.trial059.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-17T08:08:05.742 INFO:teuthology.orchestra.run.trial059.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-17T08:08:05.744 INFO:teuthology.orchestra.run.trial059.stdout:Generating grub configuration file ... 2026-02-17T08:08:05.825 INFO:teuthology.orchestra.run.trial059.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-17T08:08:05.832 INFO:teuthology.orchestra.run.trial059.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-17T08:08:06.006 INFO:teuthology.orchestra.run.trial059.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-17T08:08:06.011 INFO:teuthology.orchestra.run.trial059.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-17T08:08:06.085 INFO:teuthology.orchestra.run.trial059.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-17T08:08:06.086 INFO:teuthology.orchestra.run.trial059.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-17T08:08:06.086 INFO:teuthology.orchestra.run.trial059.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-17T08:08:06.088 INFO:teuthology.orchestra.run.trial059.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T08:08:06.097 INFO:teuthology.orchestra.run.trial059.stdout:done 2026-02-17T08:08:06.493 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-17T08:08:06.493 INFO:teuthology.orchestra.run.trial059.stdout:Pending kernel upgrade! 2026-02-17T08:08:06.494 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-17T08:08:06.494 INFO:teuthology.orchestra.run.trial059.stdout:Running kernel version: 2026-02-17T08:08:06.494 INFO:teuthology.orchestra.run.trial059.stdout: 5.15.0-164-generic 2026-02-17T08:08:06.494 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-17T08:08:06.494 INFO:teuthology.orchestra.run.trial059.stdout:Diagnostics: 2026-02-17T08:08:06.494 INFO:teuthology.orchestra.run.trial059.stdout: The currently running kernel version is not the expected kernel version 5.15.0-170-generic. 2026-02-17T08:08:06.494 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-17T08:08:06.494 INFO:teuthology.orchestra.run.trial059.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-17T08:08:06.494 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-17T08:08:06.494 INFO:teuthology.orchestra.run.trial059.stdout:The processor microcode seems to be up-to-date. 2026-02-17T08:08:06.494 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-17T08:08:06.494 INFO:teuthology.orchestra.run.trial059.stdout:No services need to be restarted. 2026-02-17T08:08:06.495 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-17T08:08:06.495 INFO:teuthology.orchestra.run.trial059.stdout:No containers need to be restarted. 2026-02-17T08:08:06.495 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-17T08:08:06.495 INFO:teuthology.orchestra.run.trial059.stdout:No user sessions are running outdated binaries. 2026-02-17T08:08:06.495 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-17T08:08:06.495 INFO:teuthology.orchestra.run.trial059.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-17T08:08:07.151 DEBUG:teuthology.orchestra.run.trial059:> dpkg -s linux-image-generic 2026-02-17T08:08:07.162 INFO:teuthology.orchestra.run.trial059.stdout:Package: linux-image-generic 2026-02-17T08:08:07.162 INFO:teuthology.orchestra.run.trial059.stdout:Status: install ok installed 2026-02-17T08:08:07.162 INFO:teuthology.orchestra.run.trial059.stdout:Priority: optional 2026-02-17T08:08:07.162 INFO:teuthology.orchestra.run.trial059.stdout:Section: kernel 2026-02-17T08:08:07.162 INFO:teuthology.orchestra.run.trial059.stdout:Installed-Size: 21 2026-02-17T08:08:07.162 INFO:teuthology.orchestra.run.trial059.stdout:Maintainer: Ubuntu Kernel Team 2026-02-17T08:08:07.162 INFO:teuthology.orchestra.run.trial059.stdout:Architecture: amd64 2026-02-17T08:08:07.163 INFO:teuthology.orchestra.run.trial059.stdout:Source: linux-meta 2026-02-17T08:08:07.163 INFO:teuthology.orchestra.run.trial059.stdout:Version: 5.15.0.170.159 2026-02-17T08:08:07.163 INFO:teuthology.orchestra.run.trial059.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-17T08:08:07.163 INFO:teuthology.orchestra.run.trial059.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-17T08:08:07.163 INFO:teuthology.orchestra.run.trial059.stdout:Recommends: thermald 2026-02-17T08:08:07.163 INFO:teuthology.orchestra.run.trial059.stdout:Description: Generic Linux kernel image 2026-02-17T08:08:07.163 INFO:teuthology.orchestra.run.trial059.stdout: This package will always depend on the latest generic kernel image 2026-02-17T08:08:07.163 INFO:teuthology.orchestra.run.trial059.stdout: available. 2026-02-17T08:08:07.164 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-164-generic Expected: 5.15.0-170-generic 2026-02-17T08:08:07.164 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T08:08:07.164 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T08:08:07.164 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T08:08:07.164 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial059.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T08:08:07.164 DEBUG:teuthology.orchestra.run.trial059:> sudo apt-get clean 2026-02-17T08:08:07.244 DEBUG:teuthology.orchestra.run.trial059:> sudo apt-get update 2026-02-17T08:08:07.423 INFO:teuthology.orchestra.run.trial059.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T08:08:07.429 INFO:teuthology.orchestra.run.trial059.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-17T08:08:07.438 INFO:teuthology.orchestra.run.trial059.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-17T08:08:07.448 INFO:teuthology.orchestra.run.trial059.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-17T08:08:08.259 INFO:teuthology.orchestra.run.trial059.stdout:Reading package lists... 2026-02-17T08:08:08.273 DEBUG:teuthology.orchestra.run.trial059:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-17T08:08:08.305 INFO:teuthology.orchestra.run.trial059.stdout:Reading package lists... 2026-02-17T08:08:08.416 INFO:teuthology.orchestra.run.trial059.stdout:Building dependency tree... 2026-02-17T08:08:08.417 INFO:teuthology.orchestra.run.trial059.stdout:Reading state information... 2026-02-17T08:08:08.503 INFO:teuthology.orchestra.run.trial059.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-17T08:08:08.504 INFO:teuthology.orchestra.run.trial059.stdout:linux-image-generic set to manually installed. 2026-02-17T08:08:08.504 INFO:teuthology.orchestra.run.trial059.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T08:08:08.504 INFO:teuthology.orchestra.run.trial059.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T08:08:08.504 INFO:teuthology.orchestra.run.trial059.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T08:08:08.504 INFO:teuthology.orchestra.run.trial059.stdout: sg3-utils-udev 2026-02-17T08:08:08.504 INFO:teuthology.orchestra.run.trial059.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T08:08:08.523 INFO:teuthology.orchestra.run.trial059.stdout:0 upgraded, 0 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T08:08:08.525 DEBUG:teuthology.orchestra.run.trial059:> dpkg -s linux-image-generic 2026-02-17T08:08:08.576 INFO:teuthology.orchestra.run.trial059.stdout:Package: linux-image-generic 2026-02-17T08:08:08.576 INFO:teuthology.orchestra.run.trial059.stdout:Status: install ok installed 2026-02-17T08:08:08.576 INFO:teuthology.orchestra.run.trial059.stdout:Priority: optional 2026-02-17T08:08:08.576 INFO:teuthology.orchestra.run.trial059.stdout:Section: kernel 2026-02-17T08:08:08.577 INFO:teuthology.orchestra.run.trial059.stdout:Installed-Size: 21 2026-02-17T08:08:08.577 INFO:teuthology.orchestra.run.trial059.stdout:Maintainer: Ubuntu Kernel Team 2026-02-17T08:08:08.577 INFO:teuthology.orchestra.run.trial059.stdout:Architecture: amd64 2026-02-17T08:08:08.577 INFO:teuthology.orchestra.run.trial059.stdout:Source: linux-meta 2026-02-17T08:08:08.577 INFO:teuthology.orchestra.run.trial059.stdout:Version: 5.15.0.170.159 2026-02-17T08:08:08.577 INFO:teuthology.orchestra.run.trial059.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-17T08:08:08.577 INFO:teuthology.orchestra.run.trial059.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-17T08:08:08.577 INFO:teuthology.orchestra.run.trial059.stdout:Recommends: thermald 2026-02-17T08:08:08.577 INFO:teuthology.orchestra.run.trial059.stdout:Description: Generic Linux kernel image 2026-02-17T08:08:08.577 INFO:teuthology.orchestra.run.trial059.stdout: This package will always depend on the latest generic kernel image 2026-02-17T08:08:08.577 INFO:teuthology.orchestra.run.trial059.stdout: available. 2026-02-17T08:08:08.579 DEBUG:teuthology.orchestra.run.trial059:> mktemp 2026-02-17T08:08:08.624 INFO:teuthology.orchestra.run.trial059.stdout:/tmp/tmp.j7AvF6sLgp 2026-02-17T08:08:08.624 DEBUG:teuthology.orchestra.run.trial059:> sudo cp /boot/grub/grub.cfg /tmp/tmp.j7AvF6sLgp 2026-02-17T08:08:08.680 DEBUG:teuthology.orchestra.run.trial059:> sudo chmod 0666 /tmp/tmp.j7AvF6sLgp 2026-02-17T08:08:08.782 DEBUG:teuthology.orchestra.remote:trial059:/tmp/tmp.j7AvF6sLgp is 7KB 2026-02-17T08:08:08.790 DEBUG:teuthology.orchestra.run.trial059:> rm -fr /tmp/tmp.j7AvF6sLgp 2026-02-17T08:08:08.795 DEBUG:teuthology.orchestra.run.trial059:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-17T08:08:08.843 DEBUG:teuthology.orchestra.run.trial059:> set -ex 2026-02-17T08:08:08.844 DEBUG:teuthology.orchestra.run.trial059:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-17T08:08:08.844 DEBUG:teuthology.orchestra.run.trial059:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-17T08:08:08.898 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-170-generic 2026-02-17T08:08:08.898 DEBUG:teuthology.orchestra.run.trial059:> sudo update-grub 2026-02-17T08:08:09.132 INFO:teuthology.orchestra.run.trial059.stderr:Sourcing file `/etc/default/grub' 2026-02-17T08:08:09.151 INFO:teuthology.orchestra.run.trial059.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-17T08:08:09.152 INFO:teuthology.orchestra.run.trial059.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-17T08:08:09.154 INFO:teuthology.orchestra.run.trial059.stderr:Generating grub configuration file ... 2026-02-17T08:08:09.236 INFO:teuthology.orchestra.run.trial059.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-17T08:08:09.242 INFO:teuthology.orchestra.run.trial059.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-17T08:08:09.407 INFO:teuthology.orchestra.run.trial059.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-17T08:08:09.413 INFO:teuthology.orchestra.run.trial059.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-17T08:08:09.482 INFO:teuthology.orchestra.run.trial059.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-17T08:08:09.483 INFO:teuthology.orchestra.run.trial059.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-17T08:08:09.483 INFO:teuthology.orchestra.run.trial059.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-17T08:08:09.485 INFO:teuthology.orchestra.run.trial059.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T08:08:09.492 INFO:teuthology.orchestra.run.trial059.stderr:done 2026-02-17T08:08:09.494 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial059 2026-02-17T08:08:09.494 DEBUG:teuthology.orchestra.run.trial059:> sudo bash -c ' 2026-02-17T08:08:09.494 DEBUG:teuthology.orchestra.run.trial059:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T08:08:09.495 DEBUG:teuthology.orchestra.run.trial059:> ' 2026-02-17T08:08:39.497 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T08:08:39.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial059.front.sepia.ceph.com' 2026-02-17T08:08:39.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:08:53.760 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.59 2026-02-17T08:09:02.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial059.front.sepia.ceph.com' 2026-02-17T08:09:02.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:10:02.826 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T08:10:14.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial059.front.sepia.ceph.com' 2026-02-17T08:10:14.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:10:15.010 DEBUG:teuthology.orchestra.run.trial059:> true 2026-02-17T08:10:15.408 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial059.front.sepia.ceph.com' 2026-02-17T08:10:15.408 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-170-generic"... 2026-02-17T08:10:15.408 DEBUG:teuthology.orchestra.run.trial059:> uname -r 2026-02-17T08:10:15.458 INFO:teuthology.orchestra.run.trial059.stdout:5.15.0-170-generic 2026-02-17T08:10:15.459 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-170-generic vs 5.15.0-170-generic 2026-02-17T08:10:15.459 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T08:10:15.459 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-17T08:10:16.459 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T08:10:16.460 DEBUG:teuthology.orchestra.run.trial059:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T08:10:16.472 INFO:teuthology.orchestra.run.trial059.stdout:ttyS1 2026-02-17T08:10:16.497 DEBUG:teuthology.parallel:result is None 2026-02-17T08:10:16.497 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T08:10:16.511 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T08:10:16.511 DEBUG:teuthology.orchestra.run.trial059:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T08:10:16.543 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T08:10:16.557 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T08:10:16.572 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T08:10:16.572 DEBUG:teuthology.orchestra.run.trial059:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T08:10:16.593 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T08:10:16.605 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T08:10:16.606 DEBUG:teuthology.orchestra.run.trial059:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T08:10:16.640 INFO:teuthology.orchestra.run.trial059.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:10:16.646 INFO:teuthology.orchestra.run.trial059.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:10:16.647 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T08:10:16.660 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T08:10:16.660 DEBUG:teuthology.orchestra.run.trial059:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T08:10:16.698 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T08:10:16.712 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T08:10:16.712 DEBUG:teuthology.orchestra.run.trial059:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T08:10:16.742 DEBUG:teuthology.orchestra.run.trial059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T08:10:16.787 DEBUG:teuthology.orchestra.run.trial059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T08:10:16.831 DEBUG:teuthology.orchestra.run.trial059:> set -ex 2026-02-17T08:10:16.831 DEBUG:teuthology.orchestra.run.trial059:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T08:10:16.880 DEBUG:teuthology.orchestra.run.trial059:> sudo service rsyslog restart 2026-02-17T08:10:16.941 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T08:10:16.953 INFO:teuthology.task.internal:Starting timer... 2026-02-17T08:10:16.954 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T08:10:16.976 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T08:10:16.990 DEBUG:teuthology.task.selinux:Excluding trial059: OS 'ubuntu' does not support SELinux 2026-02-17T08:10:16.990 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T08:10:16.990 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-17T08:10:16.990 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T08:10:16.990 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T08:10:17.007 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-17T08:10:17.009 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-17T08:10:17.113 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T08:10:17.123 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T08:10:17.125 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial059.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T08:12:43.341 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial059.front.sepia.ceph.com')] 2026-02-17T08:12:43.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial059.front.sepia.ceph.com' 2026-02-17T08:12:43.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:12:43.411 DEBUG:teuthology.orchestra.run.trial059:> true 2026-02-17T08:12:43.659 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial059.front.sepia.ceph.com' 2026-02-17T08:12:43.659 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T08:12:43.677 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T08:12:43.677 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T08:12:43.678 DEBUG:teuthology.orchestra.run.trial059:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T08:12:43.720 INFO:teuthology.orchestra.run.trial059.stdout:17 Feb 08:12:42 ntpd[8780]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-17T08:12:43.721 INFO:teuthology.orchestra.run.trial059.stdout:17 Feb 08:12:42 ntpd[8780]: Command line: ntpd -gq 2026-02-17T08:12:43.721 INFO:teuthology.orchestra.run.trial059.stdout:17 Feb 08:12:42 ntpd[8780]: ---------------------------------------------------- 2026-02-17T08:12:43.721 INFO:teuthology.orchestra.run.trial059.stdout:17 Feb 08:12:42 ntpd[8780]: ntp-4 is maintained by Network Time Foundation, 2026-02-17T08:12:43.721 INFO:teuthology.orchestra.run.trial059.stdout:17 Feb 08:12:42 ntpd[8780]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-17T08:12:43.721 INFO:teuthology.orchestra.run.trial059.stdout:17 Feb 08:12:42 ntpd[8780]: corporation. Support and training for ntp-4 are 2026-02-17T08:12:43.721 INFO:teuthology.orchestra.run.trial059.stdout:17 Feb 08:12:42 ntpd[8780]: available at https://www.nwtime.org/support 2026-02-17T08:12:43.721 INFO:teuthology.orchestra.run.trial059.stdout:17 Feb 08:12:42 ntpd[8780]: ---------------------------------------------------- 2026-02-17T08:12:43.721 INFO:teuthology.orchestra.run.trial059.stdout:17 Feb 08:12:42 ntpd[8780]: proto: precision = 0.030 usec (-25) 2026-02-17T08:12:43.721 INFO:teuthology.orchestra.run.trial059.stdout:17 Feb 08:12:42 ntpd[8780]: basedate set to 2022-02-04 2026-02-17T08:12:43.721 INFO:teuthology.orchestra.run.trial059.stdout:17 Feb 08:12:42 ntpd[8780]: gps base set to 2022-02-06 (week 2196) 2026-02-17T08:12:43.722 INFO:teuthology.orchestra.run.trial059.stdout:17 Feb 08:12:42 ntpd[8780]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-17T08:12:43.722 INFO:teuthology.orchestra.run.trial059.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-17T08:12:43.722 INFO:teuthology.orchestra.run.trial059.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-17T08:12:43.723 INFO:teuthology.orchestra.run.trial059.stdout:17 Feb 08:12:42 ntpd[8780]: restrict ::: KOD does nothing without LIMITED. 2026-02-17T08:12:43.723 INFO:teuthology.orchestra.run.trial059.stdout:17 Feb 08:12:42 ntpd[8780]: Listen and drop on 0 v6wildcard [::]:123 2026-02-17T08:12:43.723 INFO:teuthology.orchestra.run.trial059.stdout:17 Feb 08:12:42 ntpd[8780]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-17T08:12:43.723 INFO:teuthology.orchestra.run.trial059.stdout:17 Feb 08:12:42 ntpd[8780]: Listen normally on 2 lo 127.0.0.1:123 2026-02-17T08:12:43.724 INFO:teuthology.orchestra.run.trial059.stdout:17 Feb 08:12:42 ntpd[8780]: Listen normally on 3 enp1s0f0 10.20.193.59:123 2026-02-17T08:12:43.724 INFO:teuthology.orchestra.run.trial059.stdout:17 Feb 08:12:42 ntpd[8780]: Listen normally on 4 lo [::1]:123 2026-02-17T08:12:43.724 INFO:teuthology.orchestra.run.trial059.stdout:17 Feb 08:12:42 ntpd[8780]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:5de0%2]:123 2026-02-17T08:12:43.724 INFO:teuthology.orchestra.run.trial059.stdout:17 Feb 08:12:42 ntpd[8780]: Listening on routing socket on fd #22 for interface updates 2026-02-17T08:12:44.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:43 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:44.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:43 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:44.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:43 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:44.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:43 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:44.745 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:43 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:44.746 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:43 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:44.746 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:43 ntpd[8780]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:12:44.746 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:43 ntpd[8780]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:12:44.800 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:44 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:44.800 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:44 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:44.800 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:44 ntpd[8780]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:12:44.800 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:44 ntpd[8780]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:12:45.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:44 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:45.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:44 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:45.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:44 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:45.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:44 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:45.724 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:44 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:45.725 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:44 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:45.725 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:44 ntpd[8780]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:12:45.725 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:44 ntpd[8780]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:12:45.791 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:45 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:45.791 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:45 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:45.791 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:45 ntpd[8780]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:12:45.791 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:45 ntpd[8780]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:12:46.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:45 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:46.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:45 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:46.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:45 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:46.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:45 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:46.745 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:45 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:46.745 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:45 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:46.745 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:45 ntpd[8780]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:12:46.745 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:45 ntpd[8780]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:12:46.794 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:46 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:46.794 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:46 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:46.794 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:46 ntpd[8780]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:12:46.794 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:46 ntpd[8780]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:12:47.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:46 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:47.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:46 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:47.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:46 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:47.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:46 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:47.724 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:46 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:47.724 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:46 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:47.724 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:46 ntpd[8780]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:12:47.725 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:46 ntpd[8780]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:12:47.790 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:47 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:47.791 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:47 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:47.791 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:47 ntpd[8780]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:12:47.791 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:47 ntpd[8780]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:12:48.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:47 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:48.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:47 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:48.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:47 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:48.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:47 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:48.745 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:47 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:48.745 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:47 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:48.745 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:47 ntpd[8780]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:12:48.745 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:47 ntpd[8780]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:12:48.794 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:48 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:48.794 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:48 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:48.794 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:48 ntpd[8780]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:12:48.794 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:48 ntpd[8780]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:12:49.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:48 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:49.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:48 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:49.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:48 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:49.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:48 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:49.724 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:48 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:49.724 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:48 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:49.724 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:48 ntpd[8780]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:12:49.724 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:48 ntpd[8780]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:12:49.793 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:49 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:49.793 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:49 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:49.793 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:49 ntpd[8780]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:12:49.793 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:49 ntpd[8780]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:12:50.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:49 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:50.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:49 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:50.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:49 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:50.721 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:49 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:50.745 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:49 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:12:50.746 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:49 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:12:50.746 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:49 ntpd[8780]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:12:50.746 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:49 ntpd[8780]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:12:50.746 INFO:teuthology.orchestra.run.trial059.stdout:17 Feb 08:12:50 ntpd[8780]: ntpd: time set +0.745365 s 2026-02-17T08:12:50.746 INFO:teuthology.orchestra.run.trial059.stdout:ntpd: time set +0.745365s 2026-02-17T08:12:50.747 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:50 ntpd[8780]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-17T08:12:50.747 INFO:teuthology.orchestra.run.trial059.stderr:17 Feb 08:12:50 ntpd[8780]: can't open /var/log/ntpstats/loopstats.20260217: Permission denied 2026-02-17T08:12:50.802 INFO:teuthology.orchestra.run.trial059.stdout: remote refid st t when poll reach delay offset jitter 2026-02-17T08:12:50.802 INFO:teuthology.orchestra.run.trial059.stdout:============================================================================== 2026-02-17T08:12:50.802 INFO:teuthology.orchestra.run.trial059.stdout: 172-233-155-39. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T08:12:50.802 INFO:teuthology.orchestra.run.trial059.stdout: time.walb.tech .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T08:12:50.802 INFO:teuthology.orchestra.run.trial059.stdout: 23.186.168.129 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T08:12:50.802 INFO:teuthology.orchestra.run.trial059.stdout: time.meme.holdi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T08:12:50.804 INFO:teuthology.run_tasks:Running task install... 2026-02-17T08:12:50.817 DEBUG:teuthology.task.install:project ceph 2026-02-17T08:12:50.817 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}} 2026-02-17T08:12:50.818 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'} 2026-02-17T08:12:50.818 INFO:teuthology.task.install:Using flavor: default 2026-02-17T08:12:50.826 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T08:12:50.827 INFO:teuthology.task.install:extra packages: [] 2026-02-17T08:12:50.827 DEBUG:teuthology.orchestra.run.trial059:> sudo apt-key list | grep Ceph 2026-02-17T08:12:50.899 INFO:teuthology.orchestra.run.trial059.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-17T08:12:50.929 INFO:teuthology.orchestra.run.trial059.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-17T08:12:50.929 INFO:teuthology.orchestra.run.trial059.stdout:uid [ unknown] Ceph.com (release key) 2026-02-17T08:12:50.929 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-17T08:12:50.930 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:12:51.061 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default/ 2026-02-17T08:12:51.061 INFO:teuthology.task.install.deb:Package version is 19.2.3-705-g04cf6dd4-1jammy 2026-02-17T08:12:51.267 DEBUG:teuthology.orchestra.run.trial059:> set -ex 2026-02-17T08:12:51.267 DEBUG:teuthology.orchestra.run.trial059:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-17T08:12:51.276 DEBUG:teuthology.orchestra.run.trial059:> sudo apt-get update 2026-02-17T08:12:51.437 INFO:teuthology.orchestra.run.trial059.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy InRelease 2026-02-17T08:12:51.448 INFO:teuthology.orchestra.run.trial059.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy Release [7662 B] 2026-02-17T08:12:51.460 INFO:teuthology.orchestra.run.trial059.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-17T08:12:51.468 INFO:teuthology.orchestra.run.trial059.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T08:12:51.471 INFO:teuthology.orchestra.run.trial059.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2026-02-17T08:12:51.473 INFO:teuthology.orchestra.run.trial059.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-17T08:12:51.487 INFO:teuthology.orchestra.run.trial059.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-17T08:12:51.492 INFO:teuthology.orchestra.run.trial059.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-17T08:12:51.799 INFO:teuthology.orchestra.run.trial059.stdout:Fetched 25.8 kB in 0s (71.4 kB/s) 2026-02-17T08:12:52.309 INFO:teuthology.orchestra.run.trial059.stdout:Reading package lists... 2026-02-17T08:12:52.322 DEBUG:teuthology.orchestra.run.trial059:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.2.3-705-g04cf6dd4-1jammy cephadm=19.2.3-705-g04cf6dd4-1jammy ceph-mds=19.2.3-705-g04cf6dd4-1jammy ceph-mgr=19.2.3-705-g04cf6dd4-1jammy ceph-common=19.2.3-705-g04cf6dd4-1jammy ceph-fuse=19.2.3-705-g04cf6dd4-1jammy ceph-test=19.2.3-705-g04cf6dd4-1jammy ceph-volume=19.2.3-705-g04cf6dd4-1jammy radosgw=19.2.3-705-g04cf6dd4-1jammy python3-rados=19.2.3-705-g04cf6dd4-1jammy python3-rgw=19.2.3-705-g04cf6dd4-1jammy python3-cephfs=19.2.3-705-g04cf6dd4-1jammy python3-rbd=19.2.3-705-g04cf6dd4-1jammy libcephfs2=19.2.3-705-g04cf6dd4-1jammy libcephfs-dev=19.2.3-705-g04cf6dd4-1jammy librados2=19.2.3-705-g04cf6dd4-1jammy librbd1=19.2.3-705-g04cf6dd4-1jammy rbd-fuse=19.2.3-705-g04cf6dd4-1jammy 2026-02-17T08:12:52.356 INFO:teuthology.orchestra.run.trial059.stdout:Reading package lists... 2026-02-17T08:12:52.464 INFO:teuthology.orchestra.run.trial059.stdout:Building dependency tree... 2026-02-17T08:12:52.465 INFO:teuthology.orchestra.run.trial059.stdout:Reading state information... 2026-02-17T08:12:52.555 INFO:teuthology.orchestra.run.trial059.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T08:12:52.555 INFO:teuthology.orchestra.run.trial059.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T08:12:52.555 INFO:teuthology.orchestra.run.trial059.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T08:12:52.555 INFO:teuthology.orchestra.run.trial059.stdout: sg3-utils-udev 2026-02-17T08:12:52.555 INFO:teuthology.orchestra.run.trial059.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T08:12:52.555 INFO:teuthology.orchestra.run.trial059.stdout:The following additional packages will be installed: 2026-02-17T08:12:52.555 INFO:teuthology.orchestra.run.trial059.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-17T08:12:52.555 INFO:teuthology.orchestra.run.trial059.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2026-02-17T08:12:52.555 INFO:teuthology.orchestra.run.trial059.stdout: libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 2026-02-17T08:12:52.555 INFO:teuthology.orchestra.run.trial059.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-17T08:12:52.556 INFO:teuthology.orchestra.run.trial059.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2026-02-17T08:12:52.556 INFO:teuthology.orchestra.run.trial059.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2026-02-17T08:12:52.556 INFO:teuthology.orchestra.run.trial059.stdout: pkg-config python-asyncssh-doc python-pastedeploy-tpl python3-asyncssh 2026-02-17T08:12:52.556 INFO:teuthology.orchestra.run.trial059.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cheroot 2026-02-17T08:12:52.556 INFO:teuthology.orchestra.run.trial059.stdout: python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-17T08:12:52.556 INFO:teuthology.orchestra.run.trial059.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-17T08:12:52.556 INFO:teuthology.orchestra.run.trial059.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-logutils 2026-02-17T08:12:52.556 INFO:teuthology.orchestra.run.trial059.stdout: python3-mako python3-natsort python3-paste python3-pastedeploy 2026-02-17T08:12:52.556 INFO:teuthology.orchestra.run.trial059.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2026-02-17T08:12:52.556 INFO:teuthology.orchestra.run.trial059.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-17T08:12:52.556 INFO:teuthology.orchestra.run.trial059.stdout: python3-pyinotify python3-pytest python3-repoze.lru 2026-02-17T08:12:52.556 INFO:teuthology.orchestra.run.trial059.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2026-02-17T08:12:52.556 INFO:teuthology.orchestra.run.trial059.stdout: python3-simplejson python3-singledispatch python3-sklearn 2026-02-17T08:12:52.557 INFO:teuthology.orchestra.run.trial059.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2026-02-17T08:12:52.557 INFO:teuthology.orchestra.run.trial059.stdout: python3-toml python3-waitress python3-wcwidth python3-webob 2026-02-17T08:12:52.557 INFO:teuthology.orchestra.run.trial059.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2026-02-17T08:12:52.557 INFO:teuthology.orchestra.run.trial059.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2026-02-17T08:12:52.557 INFO:teuthology.orchestra.run.trial059.stdout:Suggested packages: 2026-02-17T08:12:52.557 INFO:teuthology.orchestra.run.trial059.stdout: python3-influxdb readline-doc python3-beaker python-mako-doc 2026-02-17T08:12:52.557 INFO:teuthology.orchestra.run.trial059.stdout: python-natsort-doc httpd-wsgi libapache2-mod-python libapache2-mod-scgi 2026-02-17T08:12:52.557 INFO:teuthology.orchestra.run.trial059.stdout: libjs-mochikit python-pecan-doc python-psutil-doc subversion 2026-02-17T08:12:52.557 INFO:teuthology.orchestra.run.trial059.stdout: python-pygments-doc ttf-bitstream-vera python-pyinotify-doc python3-dap 2026-02-17T08:12:52.557 INFO:teuthology.orchestra.run.trial059.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2026-02-17T08:12:52.557 INFO:teuthology.orchestra.run.trial059.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2026-02-17T08:12:52.557 INFO:teuthology.orchestra.run.trial059.stdout:Recommended packages: 2026-02-17T08:12:52.557 INFO:teuthology.orchestra.run.trial059.stdout: btrfs-tools 2026-02-17T08:12:52.590 INFO:teuthology.orchestra.run.trial059.stdout:The following NEW packages will be installed: 2026-02-17T08:12:52.590 INFO:teuthology.orchestra.run.trial059.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-17T08:12:52.590 INFO:teuthology.orchestra.run.trial059.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-17T08:12:52.590 INFO:teuthology.orchestra.run.trial059.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2026-02-17T08:12:52.590 INFO:teuthology.orchestra.run.trial059.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 2026-02-17T08:12:52.590 INFO:teuthology.orchestra.run.trial059.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2026-02-17T08:12:52.590 INFO:teuthology.orchestra.run.trial059.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2026-02-17T08:12:52.591 INFO:teuthology.orchestra.run.trial059.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2026-02-17T08:12:52.591 INFO:teuthology.orchestra.run.trial059.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2026-02-17T08:12:52.591 INFO:teuthology.orchestra.run.trial059.stdout: python-pastedeploy-tpl python3-asyncssh python3-cachetools 2026-02-17T08:12:52.591 INFO:teuthology.orchestra.run.trial059.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cheroot 2026-02-17T08:12:52.591 INFO:teuthology.orchestra.run.trial059.stdout: python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-17T08:12:52.591 INFO:teuthology.orchestra.run.trial059.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-17T08:12:52.591 INFO:teuthology.orchestra.run.trial059.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-logutils 2026-02-17T08:12:52.591 INFO:teuthology.orchestra.run.trial059.stdout: python3-mako python3-natsort python3-paste python3-pastedeploy 2026-02-17T08:12:52.591 INFO:teuthology.orchestra.run.trial059.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2026-02-17T08:12:52.591 INFO:teuthology.orchestra.run.trial059.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-17T08:12:52.591 INFO:teuthology.orchestra.run.trial059.stdout: python3-pyinotify python3-pytest python3-rados python3-rbd 2026-02-17T08:12:52.592 INFO:teuthology.orchestra.run.trial059.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2026-02-17T08:12:52.592 INFO:teuthology.orchestra.run.trial059.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2026-02-17T08:12:52.592 INFO:teuthology.orchestra.run.trial059.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2026-02-17T08:12:52.592 INFO:teuthology.orchestra.run.trial059.stdout: python3-threadpoolctl python3-toml python3-waitress python3-wcwidth 2026-02-17T08:12:52.592 INFO:teuthology.orchestra.run.trial059.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2026-02-17T08:12:52.592 INFO:teuthology.orchestra.run.trial059.stdout: python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse socat unzip 2026-02-17T08:12:52.592 INFO:teuthology.orchestra.run.trial059.stdout: xmlstarlet zip 2026-02-17T08:12:52.669 INFO:teuthology.orchestra.run.trial059.stdout:0 upgraded, 108 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T08:12:52.669 INFO:teuthology.orchestra.run.trial059.stdout:Need to get 178 MB of archives. 2026-02-17T08:12:52.669 INFO:teuthology.orchestra.run.trial059.stdout:After this operation, 809 MB of additional disk space will be used. 2026-02-17T08:12:52.669 INFO:teuthology.orchestra.run.trial059.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.2.3-705-g04cf6dd4-1jammy [3593 kB] 2026-02-17T08:12:52.770 INFO:teuthology.orchestra.run.trial059.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.2.3-705-g04cf6dd4-1jammy [3257 kB] 2026-02-17T08:12:52.815 INFO:teuthology.orchestra.run.trial059.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.2.3-705-g04cf6dd4-1jammy [979 kB] 2026-02-17T08:12:52.831 INFO:teuthology.orchestra.run.trial059.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.2.3-705-g04cf6dd4-1jammy [357 kB] 2026-02-17T08:12:52.836 INFO:teuthology.orchestra.run.trial059.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.2.3-705-g04cf6dd4-1jammy [32.9 kB] 2026-02-17T08:12:52.837 INFO:teuthology.orchestra.run.trial059.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.2.3-705-g04cf6dd4-1jammy [184 kB] 2026-02-17T08:12:52.840 INFO:teuthology.orchestra.run.trial059.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.2.3-705-g04cf6dd4-1jammy [74.1 kB] 2026-02-17T08:12:52.841 INFO:teuthology.orchestra.run.trial059.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.2.3-705-g04cf6dd4-1jammy [337 kB] 2026-02-17T08:12:52.847 INFO:teuthology.orchestra.run.trial059.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.2.3-705-g04cf6dd4-1jammy [6935 kB] 2026-02-17T08:12:52.961 INFO:teuthology.orchestra.run.trial059.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.2.3-705-g04cf6dd4-1jammy [112 kB] 2026-02-17T08:12:52.962 INFO:teuthology.orchestra.run.trial059.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.2.3-705-g04cf6dd4-1jammy [470 kB] 2026-02-17T08:12:52.969 INFO:teuthology.orchestra.run.trial059.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.2.3-705-g04cf6dd4-1jammy [26.5 MB] 2026-02-17T08:12:53.032 INFO:teuthology.orchestra.run.trial059.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-17T08:12:53.408 INFO:teuthology.orchestra.run.trial059.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.2.3-705-g04cf6dd4-1jammy [5178 kB] 2026-02-17T08:12:53.445 INFO:teuthology.orchestra.run.trial059.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-17T08:12:53.458 INFO:teuthology.orchestra.run.trial059.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-17T08:12:53.489 INFO:teuthology.orchestra.run.trial059.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.2.3-705-g04cf6dd4-1jammy [248 kB] 2026-02-17T08:12:53.493 INFO:teuthology.orchestra.run.trial059.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.2.3-705-g04cf6dd4-1jammy [125 kB] 2026-02-17T08:12:53.495 INFO:teuthology.orchestra.run.trial059.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.2.3-705-g04cf6dd4-1jammy [1081 kB] 2026-02-17T08:12:53.512 INFO:teuthology.orchestra.run.trial059.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.2.3-705-g04cf6dd4-1jammy [6239 kB] 2026-02-17T08:12:53.543 INFO:teuthology.orchestra.run.trial059.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-17T08:12:53.615 INFO:teuthology.orchestra.run.trial059.stdout:Get:22 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.2.3-705-g04cf6dd4-1jammy [23.0 MB] 2026-02-17T08:12:53.787 INFO:teuthology.orchestra.run.trial059.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-17T08:12:53.800 INFO:teuthology.orchestra.run.trial059.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-17T08:12:53.833 INFO:teuthology.orchestra.run.trial059.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-17T08:12:53.995 INFO:teuthology.orchestra.run.trial059.stdout:Get:26 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.2.3-705-g04cf6dd4-1jammy [14.2 kB] 2026-02-17T08:12:53.995 INFO:teuthology.orchestra.run.trial059.stdout:Get:27 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.2.3-705-g04cf6dd4-1jammy [1173 kB] 2026-02-17T08:12:54.011 INFO:teuthology.orchestra.run.trial059.stdout:Get:28 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.2.3-705-g04cf6dd4-1jammy [2503 kB] 2026-02-17T08:12:54.051 INFO:teuthology.orchestra.run.trial059.stdout:Get:29 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.2.3-705-g04cf6dd4-1jammy [798 kB] 2026-02-17T08:12:54.065 INFO:teuthology.orchestra.run.trial059.stdout:Get:30 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.2.3-705-g04cf6dd4-1jammy [157 kB] 2026-02-17T08:12:54.067 INFO:teuthology.orchestra.run.trial059.stdout:Get:31 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.2.3-705-g04cf6dd4-1jammy [2396 kB] 2026-02-17T08:12:54.106 INFO:teuthology.orchestra.run.trial059.stdout:Get:32 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.2.3-705-g04cf6dd4-1jammy [8625 kB] 2026-02-17T08:12:54.244 INFO:teuthology.orchestra.run.trial059.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-17T08:12:54.248 INFO:teuthology.orchestra.run.trial059.stdout:Get:34 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.2.3-705-g04cf6dd4-1jammy [14.3 kB] 2026-02-17T08:12:54.249 INFO:teuthology.orchestra.run.trial059.stdout:Get:35 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.2.3-705-g04cf6dd4-1jammy [52.1 MB] 2026-02-17T08:12:54.537 INFO:teuthology.orchestra.run.trial059.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-17T08:12:54.553 INFO:teuthology.orchestra.run.trial059.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-17T08:12:54.576 INFO:teuthology.orchestra.run.trial059.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-17T08:12:54.835 INFO:teuthology.orchestra.run.trial059.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2026-02-17T08:12:54.859 INFO:teuthology.orchestra.run.trial059.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2026-02-17T08:12:54.880 INFO:teuthology.orchestra.run.trial059.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2026-02-17T08:12:54.891 INFO:teuthology.orchestra.run.trial059.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5034 B] 2026-02-17T08:12:54.892 INFO:teuthology.orchestra.run.trial059.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2026-02-17T08:12:54.909 INFO:teuthology.orchestra.run.trial059.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2026-02-17T08:12:54.926 INFO:teuthology.orchestra.run.trial059.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2026-02-17T08:12:54.937 INFO:teuthology.orchestra.run.trial059.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-17T08:12:54.940 INFO:teuthology.orchestra.run.trial059.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-17T08:12:54.941 INFO:teuthology.orchestra.run.trial059.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-17T08:12:55.011 INFO:teuthology.orchestra.run.trial059.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-17T08:12:55.011 INFO:teuthology.orchestra.run.trial059.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-17T08:12:55.012 INFO:teuthology.orchestra.run.trial059.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-17T08:12:55.012 INFO:teuthology.orchestra.run.trial059.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-17T08:12:55.012 INFO:teuthology.orchestra.run.trial059.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-17T08:12:55.099 INFO:teuthology.orchestra.run.trial059.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-17T08:12:55.100 INFO:teuthology.orchestra.run.trial059.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-17T08:12:55.107 INFO:teuthology.orchestra.run.trial059.stdout:Get:56 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-17T08:12:55.107 INFO:teuthology.orchestra.run.trial059.stdout:Get:57 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2026-02-17T08:12:55.108 INFO:teuthology.orchestra.run.trial059.stdout:Get:58 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2026-02-17T08:12:55.110 INFO:teuthology.orchestra.run.trial059.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.2.3-705-g04cf6dd4-1jammy [135 kB] 2026-02-17T08:12:55.111 INFO:teuthology.orchestra.run.trial059.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.2.3-705-g04cf6dd4-1jammy [41.0 kB] 2026-02-17T08:12:55.111 INFO:teuthology.orchestra.run.trial059.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.2.3-705-g04cf6dd4-1jammy [13.7 MB] 2026-02-17T08:12:55.187 INFO:teuthology.orchestra.run.trial059.stdout:Get:62 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2026-02-17T08:12:55.187 INFO:teuthology.orchestra.run.trial059.stdout:Get:63 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7320 B] 2026-02-17T08:12:55.187 INFO:teuthology.orchestra.run.trial059.stdout:Get:64 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-17T08:12:55.190 INFO:teuthology.orchestra.run.trial059.stdout:Get:65 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-waitress all 1.4.4-1.1ubuntu1.1 [47.0 kB] 2026-02-17T08:12:55.192 INFO:teuthology.orchestra.run.trial059.stdout:Get:66 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2026-02-17T08:12:55.275 INFO:teuthology.orchestra.run.trial059.stdout:Get:67 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2026-02-17T08:12:55.290 INFO:teuthology.orchestra.run.trial059.stdout:Get:68 https://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4892 B] 2026-02-17T08:12:55.291 INFO:teuthology.orchestra.run.trial059.stdout:Get:69 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2026-02-17T08:12:55.291 INFO:teuthology.orchestra.run.trial059.stdout:Get:70 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2026-02-17T08:12:55.292 INFO:teuthology.orchestra.run.trial059.stdout:Get:71 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2026-02-17T08:12:55.332 INFO:teuthology.orchestra.run.trial059.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.2.3-705-g04cf6dd4-1jammy [92.1 kB] 2026-02-17T08:12:55.362 INFO:teuthology.orchestra.run.trial059.stdout:Get:73 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.3 [181 kB] 2026-02-17T08:12:55.368 INFO:teuthology.orchestra.run.trial059.stdout:Get:74 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-17T08:12:55.371 INFO:teuthology.orchestra.run.trial059.stdout:Get:75 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-17T08:12:55.378 INFO:teuthology.orchestra.run.trial059.stdout:Get:76 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-17T08:12:55.379 INFO:teuthology.orchestra.run.trial059.stdout:Get:77 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-17T08:12:55.450 INFO:teuthology.orchestra.run.trial059.stdout:Get:78 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-17T08:12:55.522 INFO:teuthology.orchestra.run.trial059.stdout:Get:79 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-17T08:12:55.529 INFO:teuthology.orchestra.run.trial059.stdout:Get:80 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-17T08:12:55.530 INFO:teuthology.orchestra.run.trial059.stdout:Get:81 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-17T08:12:55.593 INFO:teuthology.orchestra.run.trial059.stdout:Get:82 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-17T08:12:55.593 INFO:teuthology.orchestra.run.trial059.stdout:Get:83 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-17T08:12:55.594 INFO:teuthology.orchestra.run.trial059.stdout:Get:84 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-17T08:12:55.595 INFO:teuthology.orchestra.run.trial059.stdout:Get:85 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-17T08:12:55.595 INFO:teuthology.orchestra.run.trial059.stdout:Get:86 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-17T08:12:55.596 INFO:teuthology.orchestra.run.trial059.stdout:Get:87 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-17T08:12:55.628 INFO:teuthology.orchestra.run.trial059.stdout:Get:88 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-17T08:12:55.630 INFO:teuthology.orchestra.run.trial059.stdout:Get:89 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-17T08:12:55.632 INFO:teuthology.orchestra.run.trial059.stdout:Get:90 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-17T08:12:55.716 INFO:teuthology.orchestra.run.trial059.stdout:Get:91 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-17T08:12:55.720 INFO:teuthology.orchestra.run.trial059.stdout:Get:92 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-17T08:12:55.723 INFO:teuthology.orchestra.run.trial059.stdout:Get:93 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2026-02-17T08:12:55.724 INFO:teuthology.orchestra.run.trial059.stdout:Get:94 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2026-02-17T08:12:55.724 INFO:teuthology.orchestra.run.trial059.stdout:Get:95 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-17T08:12:55.730 INFO:teuthology.orchestra.run.trial059.stdout:Get:96 https://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2026-02-17T08:12:55.730 INFO:teuthology.orchestra.run.trial059.stdout:Get:97 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-17T08:12:55.804 INFO:teuthology.orchestra.run.trial059.stdout:Get:98 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-17T08:12:55.804 INFO:teuthology.orchestra.run.trial059.stdout:Get:99 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2026-02-17T08:12:55.809 INFO:teuthology.orchestra.run.trial059.stdout:Get:100 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-17T08:12:55.892 INFO:teuthology.orchestra.run.trial059.stdout:Get:101 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-17T08:12:55.893 INFO:teuthology.orchestra.run.trial059.stdout:Get:102 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-17T08:12:55.894 INFO:teuthology.orchestra.run.trial059.stdout:Get:103 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-17T08:12:55.903 INFO:teuthology.orchestra.run.trial059.stdout:Get:104 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2026-02-17T08:12:55.903 INFO:teuthology.orchestra.run.trial059.stdout:Get:105 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-17T08:12:55.903 INFO:teuthology.orchestra.run.trial059.stdout:Get:106 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-17T08:12:55.906 INFO:teuthology.orchestra.run.trial059.stdout:Get:107 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-17T08:12:55.979 INFO:teuthology.orchestra.run.trial059.stdout:Get:108 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-17T08:12:56.324 INFO:teuthology.orchestra.run.trial059.stdout:Fetched 178 MB in 3s (52.1 MB/s) 2026-02-17T08:12:56.340 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-17T08:12:56.497 INFO:teuthology.orchestra.run.trial059.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167438 files and directories currently installed.) 2026-02-17T08:12:56.498 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-17T08:12:56.499 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-17T08:12:56.520 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-17T08:12:56.533 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-17T08:12:56.534 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-17T08:12:56.550 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-17T08:12:56.562 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-17T08:12:56.562 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-17T08:12:56.583 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-17T08:12:56.591 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T08:12:56.597 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T08:12:56.626 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-17T08:12:56.634 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T08:12:56.634 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T08:12:56.650 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-17T08:12:56.659 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T08:12:56.659 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T08:12:56.677 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-17T08:12:56.685 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-17T08:12:56.686 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-17T08:12:56.701 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package librados2. 2026-02-17T08:12:56.709 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../007-librados2_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:12:56.710 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking librados2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:56.751 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package libnbd0. 2026-02-17T08:12:56.760 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2026-02-17T08:12:56.760 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-17T08:12:56.775 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package librbd1. 2026-02-17T08:12:56.783 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../009-librbd1_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:12:56.783 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking librbd1 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:56.825 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package libcephfs2. 2026-02-17T08:12:56.833 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../010-libcephfs2_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:12:56.833 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking libcephfs2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:56.854 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-rados. 2026-02-17T08:12:56.863 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../011-python3-rados_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:12:56.863 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-rados (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:56.880 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-17T08:12:56.888 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T08:12:56.888 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-ceph-argparse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:56.902 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-cephfs. 2026-02-17T08:12:56.910 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../013-python3-cephfs_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:12:56.911 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-cephfs (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:56.925 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-17T08:12:56.934 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../014-python3-ceph-common_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T08:12:56.934 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-ceph-common (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:56.952 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-17T08:12:56.960 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-17T08:12:56.961 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-17T08:12:56.977 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-prettytable. 2026-02-17T08:12:56.985 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2026-02-17T08:12:56.985 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-17T08:12:57.001 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-rbd. 2026-02-17T08:12:57.009 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../017-python3-rbd_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:12:57.009 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-rbd (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:57.027 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-17T08:12:57.035 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-17T08:12:57.036 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-17T08:12:57.054 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package libreadline-dev:amd64. 2026-02-17T08:12:57.062 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2026-02-17T08:12:57.063 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2026-02-17T08:12:57.080 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2026-02-17T08:12:57.088 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2026-02-17T08:12:57.089 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2026-02-17T08:12:57.107 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package lua5.1. 2026-02-17T08:12:57.115 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2026-02-17T08:12:57.116 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2026-02-17T08:12:57.135 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package lua-any. 2026-02-17T08:12:57.143 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2026-02-17T08:12:57.144 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking lua-any (27ubuntu1) ... 2026-02-17T08:12:57.158 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package zip. 2026-02-17T08:12:57.166 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2026-02-17T08:12:57.167 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking zip (3.0-12build2) ... 2026-02-17T08:12:57.183 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package unzip. 2026-02-17T08:12:57.191 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2026-02-17T08:12:57.192 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2026-02-17T08:12:57.211 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package luarocks. 2026-02-17T08:12:57.219 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2026-02-17T08:12:57.219 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2026-02-17T08:12:57.257 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package librgw2. 2026-02-17T08:12:57.265 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../026-librgw2_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:12:57.266 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking librgw2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:57.341 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-rgw. 2026-02-17T08:12:57.349 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../027-python3-rgw_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:12:57.350 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-rgw (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:57.365 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-17T08:12:57.373 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../028-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-17T08:12:57.373 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-17T08:12:57.388 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package libradosstriper1. 2026-02-17T08:12:57.396 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../029-libradosstriper1_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:12:57.396 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking libradosstriper1 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:57.415 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package ceph-common. 2026-02-17T08:12:57.423 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../030-ceph-common_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:12:57.423 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking ceph-common (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:57.688 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package ceph-base. 2026-02-17T08:12:57.696 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../031-ceph-base_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:12:57.701 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking ceph-base (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:57.765 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-17T08:12:57.773 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-17T08:12:57.774 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-17T08:12:57.789 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-cheroot. 2026-02-17T08:12:57.797 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-17T08:12:57.797 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-17T08:12:57.814 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-17T08:12:57.823 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-17T08:12:57.823 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-17T08:12:57.838 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-17T08:12:57.846 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-17T08:12:57.846 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-17T08:12:57.861 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-17T08:12:57.869 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-17T08:12:57.869 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-17T08:12:57.884 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-tempora. 2026-02-17T08:12:57.892 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2026-02-17T08:12:57.892 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-17T08:12:57.907 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-portend. 2026-02-17T08:12:57.916 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2026-02-17T08:12:57.916 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-17T08:12:57.930 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-17T08:12:57.938 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-17T08:12:57.938 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-17T08:12:57.953 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-17T08:12:57.961 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-17T08:12:57.961 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-17T08:12:57.985 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-natsort. 2026-02-17T08:12:57.993 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2026-02-17T08:12:57.993 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-17T08:12:58.009 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-logutils. 2026-02-17T08:12:58.018 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2026-02-17T08:12:58.018 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-logutils (0.3.3-8) ... 2026-02-17T08:12:58.033 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-mako. 2026-02-17T08:12:58.041 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2026-02-17T08:12:58.041 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2026-02-17T08:12:58.059 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-simplegeneric. 2026-02-17T08:12:58.066 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2026-02-17T08:12:58.067 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2026-02-17T08:12:58.081 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-singledispatch. 2026-02-17T08:12:58.089 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2026-02-17T08:12:58.090 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2026-02-17T08:12:58.104 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-webob. 2026-02-17T08:12:58.112 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-17T08:12:58.113 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-17T08:12:58.129 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-waitress. 2026-02-17T08:12:58.137 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1.1_all.deb ... 2026-02-17T08:12:58.140 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1.1) ... 2026-02-17T08:12:58.156 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-tempita. 2026-02-17T08:12:58.164 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2026-02-17T08:12:58.165 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2026-02-17T08:12:58.179 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-paste. 2026-02-17T08:12:58.187 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2026-02-17T08:12:58.188 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2026-02-17T08:12:58.216 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2026-02-17T08:12:58.224 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2026-02-17T08:12:58.224 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2026-02-17T08:12:58.238 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-pastedeploy. 2026-02-17T08:12:58.246 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2026-02-17T08:12:58.247 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2026-02-17T08:12:58.262 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-webtest. 2026-02-17T08:12:58.270 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2026-02-17T08:12:58.271 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-webtest (2.0.35-1) ... 2026-02-17T08:12:58.286 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-pecan. 2026-02-17T08:12:58.294 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2026-02-17T08:12:58.294 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2026-02-17T08:12:58.320 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-werkzeug. 2026-02-17T08:12:58.328 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.3_all.deb ... 2026-02-17T08:12:58.328 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.3) ... 2026-02-17T08:12:58.348 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-17T08:12:58.356 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T08:12:58.357 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking ceph-mgr-modules-core (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:58.385 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-17T08:12:58.393 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:12:58.393 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking libsqlite3-mod-ceph (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:58.409 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package ceph-mgr. 2026-02-17T08:12:58.417 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../057-ceph-mgr_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:12:58.417 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking ceph-mgr (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:58.439 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package ceph-mon. 2026-02-17T08:12:58.447 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../058-ceph-mon_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:12:58.448 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking ceph-mon (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:58.506 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-17T08:12:58.515 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../059-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-17T08:12:58.515 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-17T08:12:58.531 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package ceph-osd. 2026-02-17T08:12:58.539 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../060-ceph-osd_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:12:58.540 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking ceph-osd (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:58.693 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package ceph. 2026-02-17T08:12:58.702 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../061-ceph_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:12:58.702 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking ceph (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:58.716 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package ceph-fuse. 2026-02-17T08:12:58.724 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../062-ceph-fuse_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:12:58.725 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking ceph-fuse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:58.750 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package ceph-mds. 2026-02-17T08:12:58.758 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../063-ceph-mds_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:12:58.759 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking ceph-mds (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:58.792 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package cephadm. 2026-02-17T08:12:58.800 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../064-cephadm_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:12:58.801 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking cephadm (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:58.817 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-17T08:12:58.825 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-17T08:12:58.825 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-17T08:12:58.847 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-17T08:12:58.856 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../066-ceph-mgr-cephadm_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T08:12:58.856 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking ceph-mgr-cephadm (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:58.877 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-17T08:12:58.884 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../067-python3-repoze.lru_0.7-2_all.deb ... 2026-02-17T08:12:58.885 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-17T08:12:58.900 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-routes. 2026-02-17T08:12:58.909 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../068-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-17T08:12:58.909 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-17T08:12:58.929 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-17T08:12:58.937 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../069-ceph-mgr-dashboard_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T08:12:58.937 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking ceph-mgr-dashboard (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:59.141 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-17T08:12:59.149 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-17T08:12:59.150 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-17T08:12:59.195 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-joblib. 2026-02-17T08:12:59.203 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../071-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-17T08:12:59.204 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-17T08:12:59.231 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-17T08:12:59.239 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../072-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-17T08:12:59.239 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-17T08:12:59.254 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-sklearn. 2026-02-17T08:12:59.263 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../073-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-17T08:12:59.263 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-17T08:12:59.346 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-17T08:12:59.354 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../074-ceph-mgr-diskprediction-local_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T08:12:59.355 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking ceph-mgr-diskprediction-local (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:59.517 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-cachetools. 2026-02-17T08:12:59.527 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../075-python3-cachetools_5.0.0-1_all.deb ... 2026-02-17T08:12:59.527 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-17T08:12:59.541 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-rsa. 2026-02-17T08:12:59.549 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../076-python3-rsa_4.8-1_all.deb ... 2026-02-17T08:12:59.549 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-17T08:12:59.565 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-google-auth. 2026-02-17T08:12:59.574 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-3_all.deb ... 2026-02-17T08:12:59.574 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-17T08:12:59.590 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-17T08:12:59.598 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../078-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-17T08:12:59.598 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-17T08:12:59.613 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-websocket. 2026-02-17T08:12:59.622 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../079-python3-websocket_1.2.3-1_all.deb ... 2026-02-17T08:12:59.622 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-17T08:12:59.639 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-17T08:12:59.647 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../080-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-17T08:12:59.648 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-17T08:12:59.741 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-17T08:12:59.750 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../081-ceph-mgr-k8sevents_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T08:12:59.750 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking ceph-mgr-k8sevents (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:12:59.765 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-17T08:12:59.773 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../082-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-17T08:12:59.780 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-17T08:12:59.796 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-17T08:12:59.804 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../083-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-17T08:12:59.805 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-17T08:12:59.819 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package jq. 2026-02-17T08:12:59.828 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../084-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-17T08:12:59.828 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-17T08:12:59.843 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package socat. 2026-02-17T08:12:59.851 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../085-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-17T08:12:59.852 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-17T08:12:59.871 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package xmlstarlet. 2026-02-17T08:12:59.879 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-17T08:12:59.879 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-17T08:12:59.916 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package ceph-test. 2026-02-17T08:12:59.924 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../087-ceph-test_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:12:59.925 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking ceph-test (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:00.391 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package ceph-volume. 2026-02-17T08:13:00.400 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../088-ceph-volume_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T08:13:00.400 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking ceph-volume (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:00.424 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-17T08:13:00.432 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../089-libcephfs-dev_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:13:00.433 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking libcephfs-dev (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:00.448 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package lua-socket:amd64. 2026-02-17T08:13:00.457 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../090-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2026-02-17T08:13:00.458 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2026-02-17T08:13:00.478 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package lua-sec:amd64. 2026-02-17T08:13:00.487 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../091-lua-sec_1.0.2-1_amd64.deb ... 2026-02-17T08:13:00.487 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2026-02-17T08:13:00.505 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package nvme-cli. 2026-02-17T08:13:00.514 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../092-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-17T08:13:00.514 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-17T08:13:00.547 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package pkg-config. 2026-02-17T08:13:00.556 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../093-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2026-02-17T08:13:00.556 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2026-02-17T08:13:00.572 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-17T08:13:00.581 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../094-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-17T08:13:00.581 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-17T08:13:00.610 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-17T08:13:00.619 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../095-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-17T08:13:00.619 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-17T08:13:00.635 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-pastescript. 2026-02-17T08:13:00.643 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../096-python3-pastescript_2.0.2-4_all.deb ... 2026-02-17T08:13:00.644 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2026-02-17T08:13:00.662 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-pluggy. 2026-02-17T08:13:00.670 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../097-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-17T08:13:00.670 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-17T08:13:00.686 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-psutil. 2026-02-17T08:13:00.695 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../098-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-17T08:13:00.695 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-17T08:13:00.714 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-py. 2026-02-17T08:13:00.722 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../099-python3-py_1.10.0-1_all.deb ... 2026-02-17T08:13:00.723 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-17T08:13:00.743 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-pygments. 2026-02-17T08:13:00.752 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../100-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-17T08:13:00.752 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-17T08:13:00.794 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-pyinotify. 2026-02-17T08:13:00.803 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../101-python3-pyinotify_0.9.6-1.3_all.deb ... 2026-02-17T08:13:00.803 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2026-02-17T08:13:00.819 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-toml. 2026-02-17T08:13:00.827 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../102-python3-toml_0.10.2-1_all.deb ... 2026-02-17T08:13:00.828 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-17T08:13:00.843 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-pytest. 2026-02-17T08:13:00.852 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../103-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-17T08:13:00.852 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-17T08:13:00.875 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package python3-simplejson. 2026-02-17T08:13:00.883 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../104-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-17T08:13:00.884 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-17T08:13:00.902 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-17T08:13:00.910 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../105-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-17T08:13:00.910 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-17T08:13:00.978 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package radosgw. 2026-02-17T08:13:00.986 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../106-radosgw_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:13:00.987 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking radosgw (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:01.098 INFO:teuthology.orchestra.run.trial059.stdout:Selecting previously unselected package rbd-fuse. 2026-02-17T08:13:01.107 INFO:teuthology.orchestra.run.trial059.stdout:Preparing to unpack .../107-rbd-fuse_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:13:01.107 INFO:teuthology.orchestra.run.trial059.stdout:Unpacking rbd-fuse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:01.136 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-17T08:13:01.203 INFO:teuthology.orchestra.run.trial059.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-17T08:13:01.204 INFO:teuthology.orchestra.run.trial059.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-17T08:13:01.278 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T08:13:01.577 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-17T08:13:01.963 INFO:teuthology.orchestra.run.trial059.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-17T08:13:01.973 INFO:teuthology.orchestra.run.trial059.stdout:Setting up cephadm (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:02.015 INFO:teuthology.orchestra.run.trial059.stdout:Adding system user cephadm....done 2026-02-17T08:13:02.025 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1.1) ... 2026-02-17T08:13:02.095 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-17T08:13:02.168 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-17T08:13:02.169 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-17T08:13:02.241 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-17T08:13:02.315 INFO:teuthology.orchestra.run.trial059.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-17T08:13:02.316 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-17T08:13:02.411 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-17T08:13:02.536 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-17T08:13:02.611 INFO:teuthology.orchestra.run.trial059.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2026-02-17T08:13:02.623 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2026-02-17T08:13:02.697 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-17T08:13:02.770 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-ceph-argparse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:02.838 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-17T08:13:02.839 INFO:teuthology.orchestra.run.trial059.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-17T08:13:02.840 INFO:teuthology.orchestra.run.trial059.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2026-02-17T08:13:02.841 INFO:teuthology.orchestra.run.trial059.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2026-02-17T08:13:02.842 INFO:teuthology.orchestra.run.trial059.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-17T08:13:02.843 INFO:teuthology.orchestra.run.trial059.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2026-02-17T08:13:02.859 INFO:teuthology.orchestra.run.trial059.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2026-02-17T08:13:02.861 INFO:teuthology.orchestra.run.trial059.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2026-02-17T08:13:02.862 INFO:teuthology.orchestra.run.trial059.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-17T08:13:02.863 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-17T08:13:02.984 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-17T08:13:03.062 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-17T08:13:03.143 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-17T08:13:03.233 INFO:teuthology.orchestra.run.trial059.stdout:Setting up zip (3.0-12build2) ... 2026-02-17T08:13:03.234 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-17T08:13:03.486 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2026-02-17T08:13:03.565 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2026-02-17T08:13:03.566 INFO:teuthology.orchestra.run.trial059.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-17T08:13:03.567 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-17T08:13:03.662 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-17T08:13:03.788 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2026-02-17T08:13:03.917 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-17T08:13:03.998 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.3) ... 2026-02-17T08:13:04.103 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-17T08:13:04.177 INFO:teuthology.orchestra.run.trial059.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-17T08:13:04.178 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-ceph-common (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:04.262 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-17T08:13:04.765 INFO:teuthology.orchestra.run.trial059.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2026-02-17T08:13:04.787 INFO:teuthology.orchestra.run.trial059.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T08:13:04.791 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-17T08:13:04.869 INFO:teuthology.orchestra.run.trial059.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-17T08:13:04.869 INFO:teuthology.orchestra.run.trial059.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-17T08:13:04.870 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-17T08:13:04.947 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-17T08:13:05.021 INFO:teuthology.orchestra.run.trial059.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T08:13:05.022 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-17T08:13:05.102 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2026-02-17T08:13:05.174 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-logutils (0.3.3-8) ... 2026-02-17T08:13:05.249 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-17T08:13:05.323 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2026-02-17T08:13:05.396 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-17T08:13:05.476 INFO:teuthology.orchestra.run.trial059.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-17T08:13:05.477 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-17T08:13:05.560 INFO:teuthology.orchestra.run.trial059.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-17T08:13:05.561 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-17T08:13:05.637 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2026-02-17T08:13:05.715 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-17T08:13:05.800 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-17T08:13:05.878 INFO:teuthology.orchestra.run.trial059.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2026-02-17T08:13:05.879 INFO:teuthology.orchestra.run.trial059.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2026-02-17T08:13:05.879 INFO:teuthology.orchestra.run.trial059.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-17T08:13:05.880 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-17T08:13:06.015 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2026-02-17T08:13:06.092 INFO:teuthology.orchestra.run.trial059.stdout:Setting up lua-any (27ubuntu1) ... 2026-02-17T08:13:06.093 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-17T08:13:06.168 INFO:teuthology.orchestra.run.trial059.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T08:13:06.169 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-17T08:13:06.253 INFO:teuthology.orchestra.run.trial059.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-17T08:13:06.254 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-webtest (2.0.35-1) ... 2026-02-17T08:13:06.336 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-17T08:13:06.474 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-pastescript (2.0.2-4) ... 2026-02-17T08:13:06.561 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2026-02-17T08:13:06.673 INFO:teuthology.orchestra.run.trial059.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-17T08:13:06.674 INFO:teuthology.orchestra.run.trial059.stdout:Setting up librados2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:06.675 INFO:teuthology.orchestra.run.trial059.stdout:Setting up libsqlite3-mod-ceph (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:06.676 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-17T08:13:07.198 INFO:teuthology.orchestra.run.trial059.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2026-02-17T08:13:07.211 INFO:teuthology.orchestra.run.trial059.stdout:Setting up libcephfs2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:07.212 INFO:teuthology.orchestra.run.trial059.stdout:Setting up libradosstriper1 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:07.213 INFO:teuthology.orchestra.run.trial059.stdout:Setting up librbd1 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:07.214 INFO:teuthology.orchestra.run.trial059.stdout:Setting up ceph-mgr-modules-core (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:07.215 INFO:teuthology.orchestra.run.trial059.stdout:Setting up ceph-fuse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:07.284 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-17T08:13:07.284 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-17T08:13:07.682 INFO:teuthology.orchestra.run.trial059.stdout:Setting up libcephfs-dev (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:07.683 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-rados (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:07.684 INFO:teuthology.orchestra.run.trial059.stdout:Setting up librgw2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:07.685 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-rbd (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:07.686 INFO:teuthology.orchestra.run.trial059.stdout:Setting up rbd-fuse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:07.687 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-rgw (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:07.687 INFO:teuthology.orchestra.run.trial059.stdout:Setting up python3-cephfs (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:07.688 INFO:teuthology.orchestra.run.trial059.stdout:Setting up ceph-common (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:07.717 INFO:teuthology.orchestra.run.trial059.stdout:Adding group ceph....done 2026-02-17T08:13:07.753 INFO:teuthology.orchestra.run.trial059.stdout:Adding system user ceph....done 2026-02-17T08:13:07.763 INFO:teuthology.orchestra.run.trial059.stdout:Setting system user ceph properties....done 2026-02-17T08:13:07.769 INFO:teuthology.orchestra.run.trial059.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-17T08:13:07.856 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-17T08:13:08.148 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-17T08:13:08.547 INFO:teuthology.orchestra.run.trial059.stdout:Setting up ceph-test (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:08.548 INFO:teuthology.orchestra.run.trial059.stdout:Setting up radosgw (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:08.819 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-17T08:13:08.819 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-17T08:13:09.202 INFO:teuthology.orchestra.run.trial059.stdout:Setting up ceph-base (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:09.319 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-17T08:13:09.708 INFO:teuthology.orchestra.run.trial059.stdout:Setting up ceph-mds (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:09.769 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-17T08:13:09.770 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-17T08:13:10.163 INFO:teuthology.orchestra.run.trial059.stdout:Setting up ceph-mgr (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:10.242 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-17T08:13:10.243 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-17T08:13:10.636 INFO:teuthology.orchestra.run.trial059.stdout:Setting up ceph-osd (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:10.721 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-17T08:13:10.722 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-17T08:13:11.122 INFO:teuthology.orchestra.run.trial059.stdout:Setting up ceph-mgr-k8sevents (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:11.123 INFO:teuthology.orchestra.run.trial059.stdout:Setting up ceph-mgr-diskprediction-local (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:11.133 INFO:teuthology.orchestra.run.trial059.stdout:Setting up ceph-mon (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:11.205 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-17T08:13:11.205 INFO:teuthology.orchestra.run.trial059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-17T08:13:11.588 INFO:teuthology.orchestra.run.trial059.stdout:Setting up ceph-mgr-cephadm (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:11.599 INFO:teuthology.orchestra.run.trial059.stdout:Setting up ceph (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:11.600 INFO:teuthology.orchestra.run.trial059.stdout:Setting up ceph-mgr-dashboard (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:11.612 INFO:teuthology.orchestra.run.trial059.stdout:Setting up ceph-volume (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:13:11.724 INFO:teuthology.orchestra.run.trial059.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2026-02-17T08:13:11.731 INFO:teuthology.orchestra.run.trial059.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.11) ... 2026-02-17T08:13:11.748 INFO:teuthology.orchestra.run.trial059.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-17T08:13:11.832 INFO:teuthology.orchestra.run.trial059.stdout:Processing triggers for install-info (6.8-4build1) ... 2026-02-17T08:13:12.299 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-17T08:13:12.299 INFO:teuthology.orchestra.run.trial059.stdout:Running kernel seems to be up-to-date. 2026-02-17T08:13:12.299 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-17T08:13:12.300 INFO:teuthology.orchestra.run.trial059.stdout:The processor microcode seems to be up-to-date. 2026-02-17T08:13:12.300 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-17T08:13:12.300 INFO:teuthology.orchestra.run.trial059.stdout:No services need to be restarted. 2026-02-17T08:13:12.300 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-17T08:13:12.300 INFO:teuthology.orchestra.run.trial059.stdout:No containers need to be restarted. 2026-02-17T08:13:12.300 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-17T08:13:12.300 INFO:teuthology.orchestra.run.trial059.stdout:No user sessions are running outdated binaries. 2026-02-17T08:13:12.300 INFO:teuthology.orchestra.run.trial059.stdout: 2026-02-17T08:13:12.300 INFO:teuthology.orchestra.run.trial059.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-17T08:13:12.958 INFO:teuthology.orchestra.run.trial059.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-17T08:13:12.965 DEBUG:teuthology.parallel:result is None 2026-02-17T08:13:12.966 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:13:13.128 DEBUG:teuthology.orchestra.run.trial059:> dpkg-query -W -f '${Version}' ceph 2026-02-17T08:13:13.140 INFO:teuthology.orchestra.run.trial059.stdout:19.2.3-705-g04cf6dd4-1jammy 2026-02-17T08:13:13.140 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-705-g04cf6dd4-1jammy 2026-02-17T08:13:13.141 INFO:teuthology.task.install:The correct ceph version 19.2.3-705-g04cf6dd4-1jammy is installed. 2026-02-17T08:13:13.143 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T08:13:13.144 DEBUG:teuthology.orchestra.run.trial059:> set -ex 2026-02-17T08:13:13.144 DEBUG:teuthology.orchestra.run.trial059:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T08:13:13.192 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T08:13:13.192 DEBUG:teuthology.orchestra.run.trial059:> set -ex 2026-02-17T08:13:13.193 DEBUG:teuthology.orchestra.run.trial059:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T08:13:13.243 DEBUG:teuthology.orchestra.run.trial059:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T08:13:13.291 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T08:13:13.291 DEBUG:teuthology.orchestra.run.trial059:> set -ex 2026-02-17T08:13:13.291 DEBUG:teuthology.orchestra.run.trial059:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T08:13:13.344 DEBUG:teuthology.orchestra.run.trial059:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T08:13:13.395 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T08:13:13.396 DEBUG:teuthology.orchestra.run.trial059:> set -ex 2026-02-17T08:13:13.396 DEBUG:teuthology.orchestra.run.trial059:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T08:13:13.444 DEBUG:teuthology.orchestra.run.trial059:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T08:13:13.495 INFO:teuthology.run_tasks:Running task workunit... 2026-02-17T08:13:13.523 INFO:tasks.workunit:Pulling workunits from ref 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:13:13.524 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-17T08:13:13.524 INFO:tasks.workunit:timeout=3h 2026-02-17T08:13:13.524 INFO:tasks.workunit:cleanup=True 2026-02-17T08:13:13.525 DEBUG:teuthology.orchestra.run.trial059:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-17T08:13:13.539 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:13:13.540 INFO:teuthology.orchestra.run.trial059.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-17T08:13:13.540 DEBUG:teuthology.orchestra.run.trial059:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-17T08:13:13.587 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-17T08:13:13.588 DEBUG:teuthology.orchestra.run.trial059:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-17T08:13:13.632 DEBUG:teuthology.orchestra.run.trial059:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:13:13.682 INFO:tasks.workunit.client.0.trial059.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-17T08:13:35.487 INFO:tasks.workunit.client.0.trial059.stderr:Note: switching to '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'. 2026-02-17T08:13:35.488 INFO:tasks.workunit.client.0.trial059.stderr: 2026-02-17T08:13:35.488 INFO:tasks.workunit.client.0.trial059.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-17T08:13:35.488 INFO:tasks.workunit.client.0.trial059.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-17T08:13:35.488 INFO:tasks.workunit.client.0.trial059.stderr:state without impacting any branches by switching back to a branch. 2026-02-17T08:13:35.488 INFO:tasks.workunit.client.0.trial059.stderr: 2026-02-17T08:13:35.488 INFO:tasks.workunit.client.0.trial059.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-17T08:13:35.488 INFO:tasks.workunit.client.0.trial059.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-17T08:13:35.488 INFO:tasks.workunit.client.0.trial059.stderr: 2026-02-17T08:13:35.488 INFO:tasks.workunit.client.0.trial059.stderr: git switch -c 2026-02-17T08:13:35.488 INFO:tasks.workunit.client.0.trial059.stderr: 2026-02-17T08:13:35.488 INFO:tasks.workunit.client.0.trial059.stderr:Or undo this operation with: 2026-02-17T08:13:35.488 INFO:tasks.workunit.client.0.trial059.stderr: 2026-02-17T08:13:35.488 INFO:tasks.workunit.client.0.trial059.stderr: git switch - 2026-02-17T08:13:35.488 INFO:tasks.workunit.client.0.trial059.stderr: 2026-02-17T08:13:35.488 INFO:tasks.workunit.client.0.trial059.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-17T08:13:35.488 INFO:tasks.workunit.client.0.trial059.stderr: 2026-02-17T08:13:35.488 INFO:tasks.workunit.client.0.trial059.stderr:HEAD is now at 04cf6dd4be4 Merge branch 'wip-squid-update-spdk' of https://github.com/tchaikov/ceph into wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T08:13:35.497 DEBUG:teuthology.orchestra.run.trial059:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-17T08:13:35.545 DEBUG:teuthology.orchestra.run.trial059:> set -ex 2026-02-17T08:13:35.545 DEBUG:teuthology.orchestra.run.trial059:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-17T08:13:35.593 INFO:tasks.workunit:Running workunits matching erasure-code on client.0... 2026-02-17T08:13:35.594 INFO:tasks.workunit:Running workunit erasure-code/test-erasure-code-plugins.sh... 2026-02-17T08:13:35.594 DEBUG:teuthology.orchestra.run.trial059:workunit test erasure-code/test-erasure-code-plugins.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh 2026-02-17T08:13:35.644 INFO:tasks.workunit.client.0.trial059.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh 2026-02-17T08:13:35.644 INFO:tasks.workunit.client.0.trial059.stderr:++ TIMEOUT=300 2026-02-17T08:13:35.644 INFO:tasks.workunit.client.0.trial059.stderr:++ WAIT_FOR_CLEAN_TIMEOUT=90 2026-02-17T08:13:35.644 INFO:tasks.workunit.client.0.trial059.stderr:++ MAX_TIMEOUT=15 2026-02-17T08:13:35.645 INFO:tasks.workunit.client.0.trial059.stderr:++ PG_NUM=4 2026-02-17T08:13:35.645 INFO:tasks.workunit.client.0.trial059.stderr:++ TMPDIR=/tmp 2026-02-17T08:13:35.645 INFO:tasks.workunit.client.0.trial059.stderr:++ CEPH_BUILD_VIRTUALENV=/tmp 2026-02-17T08:13:35.645 INFO:tasks.workunit.client.0.trial059.stderr:++ TESTDIR=/home/ubuntu/cephtest 2026-02-17T08:13:35.645 INFO:tasks.workunit.client.0.trial059.stderr:++ type xmlstarlet 2026-02-17T08:13:35.645 INFO:tasks.workunit.client.0.trial059.stderr:++ XMLSTARLET=xmlstarlet 2026-02-17T08:13:35.645 INFO:tasks.workunit.client.0.trial059.stderr:+++ uname 2026-02-17T08:13:35.645 INFO:tasks.workunit.client.0.trial059.stderr:++ '[' Linux = FreeBSD ']' 2026-02-17T08:13:35.646 INFO:tasks.workunit.client.0.trial059.stderr:++ SED=sed 2026-02-17T08:13:35.646 INFO:tasks.workunit.client.0.trial059.stderr:++ AWK=awk 2026-02-17T08:13:35.646 INFO:tasks.workunit.client.0.trial059.stderr:+++ stty -a 2026-02-17T08:13:35.646 INFO:tasks.workunit.client.0.trial059.stderr:+++ head -1 2026-02-17T08:13:35.646 INFO:tasks.workunit.client.0.trial059.stderr:+++ sed -e 's/.*columns \([0-9]*\).*/\1/' 2026-02-17T08:13:35.647 INFO:tasks.workunit.client.0.trial059.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T08:13:35.647 INFO:tasks.workunit.client.0.trial059.stderr:++ termwidth= 2026-02-17T08:13:35.647 INFO:tasks.workunit.client.0.trial059.stderr:++ '[' -n '' -a '' '!=' 0 ']' 2026-02-17T08:13:35.647 INFO:tasks.workunit.client.0.trial059.stderr:++ DIFFCOLOPTS='-y ' 2026-02-17T08:13:35.647 INFO:tasks.workunit.client.0.trial059.stderr:++ KERNCORE=kernel.core_pattern 2026-02-17T08:13:35.648 INFO:tasks.workunit.client.0.trial059.stderr:++ EXTRA_OPTS= 2026-02-17T08:13:35.649 INFO:tasks.workunit.client.0.trial059.stderr:++ test '' = TESTS 2026-02-17T08:13:35.649 INFO:tasks.workunit.client.0.trial059.stderr:++ uname -m 2026-02-17T08:13:35.652 INFO:tasks.workunit.client.0.trial059.stderr:+ arch=x86_64 2026-02-17T08:13:35.652 INFO:tasks.workunit.client.0.trial059.stderr:+ case $arch in 2026-02-17T08:13:35.652 INFO:tasks.workunit.client.0.trial059.stderr:+ legacy_jerasure_plugins=(jerasure_generic jerasure_sse3 jerasure_sse4) 2026-02-17T08:13:35.652 INFO:tasks.workunit.client.0.trial059.stderr:+ legacy_shec_plugins=(shec_generic shec_sse3 shec_sse4) 2026-02-17T08:13:35.652 INFO:tasks.workunit.client.0.trial059.stderr:+ plugins=(jerasure shec lrc isa) 2026-02-17T08:13:35.652 INFO:tasks.workunit.client.0.trial059.stderr:+ main test-erasure-code-plugins 2026-02-17T08:13:35.652 INFO:tasks.workunit.client.0.trial059.stderr:+ local dir=td/test-erasure-code-plugins 2026-02-17T08:13:35.652 INFO:tasks.workunit.client.0.trial059.stderr:+ shift 2026-02-17T08:13:35.652 INFO:tasks.workunit.client.0.trial059.stderr:+ shopt -s -o xtrace 2026-02-17T08:13:35.652 INFO:tasks.workunit.client.0.trial059.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T08:13:35.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T08:13:35.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T08:13:35.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: export PYTHONWARNINGS=ignore 2026-02-17T08:13:35.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: PYTHONWARNINGS=ignore 2026-02-17T08:13:35.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: export CEPH_CONF=/dev/null 2026-02-17T08:13:35.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: CEPH_CONF=/dev/null 2026-02-17T08:13:35.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: main: unset CEPH_ARGS 2026-02-17T08:13:35.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2375: main: local code 2026-02-17T08:13:35.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: main: run td/test-erasure-code-plugins 2026-02-17T08:13:35.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:26: run: local dir=td/test-erasure-code-plugins 2026-02-17T08:13:35.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:27: run: shift 2026-02-17T08:13:35.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:29: run: export CEPH_MON=127.0.0.1:17110 2026-02-17T08:13:35.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:29: run: CEPH_MON=127.0.0.1:17110 2026-02-17T08:13:35.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:30: run: export CEPH_ARGS 2026-02-17T08:13:35.653 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:31: run: uuidgen 2026-02-17T08:13:35.654 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:31: run: CEPH_ARGS+='--fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none ' 2026-02-17T08:13:35.654 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:32: run: CEPH_ARGS+='--mon-host=127.0.0.1:17110 ' 2026-02-17T08:13:35.654 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:34: run: set 2026-02-17T08:13:35.654 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:34: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T08:13:35.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:34: run: local 'funcs=TEST_ec_profile_warning 2026-02-17T08:13:35.656 INFO:tasks.workunit.client.0.trial059.stderr:TEST_preload_no_warning 2026-02-17T08:13:35.656 INFO:tasks.workunit.client.0.trial059.stderr:TEST_preload_no_warning_default 2026-02-17T08:13:35.656 INFO:tasks.workunit.client.0.trial059.stderr:TEST_preload_warning' 2026-02-17T08:13:35.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:35: run: for func in $funcs 2026-02-17T08:13:35.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:36: run: TEST_ec_profile_warning td/test-erasure-code-plugins 2026-02-17T08:13:35.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:92: TEST_ec_profile_warning: local dir=td/test-erasure-code-plugins 2026-02-17T08:13:35.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:94: TEST_ec_profile_warning: setup td/test-erasure-code-plugins 2026-02-17T08:13:35.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-code-plugins 2026-02-17T08:13:35.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-code-plugins 2026-02-17T08:13:35.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:13:35.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:13:35.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:13:35.656 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:13:35.657 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:13:35.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:13:35.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:13:35.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:13:35.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:13:35.658 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:13:35.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:13:35.659 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:13:35.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:13:35.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:13:35.661 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:13:35.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:13:35.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:13:35.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:13:35.663 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:13:35.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:13:35.665 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:13:35.665 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:13:35.667 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:13:35.667 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:13:35.667 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:13:35.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:13:35.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:13:35.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:13:35.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-code-plugins 2026-02-17T08:13:35.670 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:13:35.670 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:13:35.670 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:13:35.670 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.11805 2026-02-17T08:13:35.672 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:13:35.673 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2026-02-17T08:13:35.673 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2026-02-17T08:13:35.673 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:13:35.673 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-17T08:13:35.673 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:95: TEST_ec_profile_warning: run_mon td/test-erasure-code-plugins a 2026-02-17T08:13:35.673 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-code-plugins 2026-02-17T08:13:35.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:13:35.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:13:35.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:13:35.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-17T08:13:35.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins 2026-02-17T08:13:35.709 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:13:35.710 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:13:35.710 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:13:35.710 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:13:35.710 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:13:35.710 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:13:35.710 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:13:35.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T08:13:35.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:13:35.743 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:13:35.743 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:13:35.743 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:13:35.743 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:13:35.743 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:13:35.744 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:13:35.745 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:13:35.745 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:13:35.745 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:13:35.745 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:13:35.745 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:13:35.745 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:13:35.745 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:13:35.745 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11805/ceph-mon.a.asok config get fsid 2026-02-17T08:13:35.817 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:13:35.817 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:13:35.817 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:13:35.817 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:13:35.817 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:13:35.817 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:13:35.817 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:13:35.818 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:13:35.818 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:13:35.819 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:13:35.819 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:13:35.819 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:13:35.819 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:13:35.819 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11805/ceph-mon.a.asok config get mon_host 2026-02-17T08:13:35.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:96: TEST_ec_profile_warning: run_mgr td/test-erasure-code-plugins x 2026-02-17T08:13:35.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-17T08:13:35.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:13:35.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:13:35.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:13:35.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-17T08:13:35.874 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:13:35.981 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:13:35.981 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:13:35.981 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:13:35.981 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:13:35.981 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:13:35.981 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:13:35.981 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:13:35.982 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:13:35.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:13:36.003 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:97: TEST_ec_profile_warning: seq 0 2 2026-02-17T08:13:36.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:97: TEST_ec_profile_warning: for id in $(seq 0 2) 2026-02-17T08:13:36.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:98: TEST_ec_profile_warning: run_osd td/test-erasure-code-plugins 0 2026-02-17T08:13:36.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code-plugins 2026-02-17T08:13:36.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:13:36.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:13:36.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:13:36.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-17T08:13:36.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-17T08:13:36.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:13:36.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:13:36.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:13:36.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-17T08:13:36.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-17T08:13:36.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:13:36.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:13:36.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-17T08:13:36.007 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:13:36.007 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:13:36.007 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:13:36.007 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:13:36.008 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:13:36.008 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:13:36.008 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:13:36.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:13:36.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:13:36.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:13:36.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:13:36.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-17T08:13:36.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-17T08:13:36.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:13:36.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:13:36.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:13:36.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:13:36.009 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:13:36.009 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:13:36.009 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-17T08:13:36.009 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:13:36.010 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=da982f19-dc77-453f-b3f2-eec4b4e9bb7f 2026-02-17T08:13:36.010 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 da982f19-dc77-453f-b3f2-eec4b4e9bb7f' 2026-02-17T08:13:36.010 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 da982f19-dc77-453f-b3f2-eec4b4e9bb7f 2026-02-17T08:13:36.010 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:13:36.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAwI5RpHincABAAXQZF6jGZdBvuMOZOQpTQZA== 2026-02-17T08:13:36.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAwI5RpHincABAAXQZF6jGZdBvuMOZOQpTQZA=="}' 2026-02-17T08:13:36.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new da982f19-dc77-453f-b3f2-eec4b4e9bb7f -i td/test-erasure-code-plugins/0/new.json 2026-02-17T08:13:36.134 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:13:36.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-17T08:13:36.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAwI5RpHincABAAXQZF6jGZdBvuMOZOQpTQZA== --osd-uuid da982f19-dc77-453f-b3f2-eec4b4e9bb7f 2026-02-17T08:13:36.157 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:36.150+0000 7f6482f5f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:13:36.159 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:36.150+0000 7f6482f5f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:13:36.160 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:36.150+0000 7f6482f5f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:13:36.161 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:36.154+0000 7f6482f5f8c0 -1 bdev(0x5610b0dd7c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:13:36.161 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:36.154+0000 7f6482f5f8c0 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-17T08:13:39.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-17T08:13:39.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:13:39.019 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:13:39.019 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:13:39.019 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:13:39.292 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:13:39.293 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:13:39.293 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:13:39.293 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:13:39.293 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:13:39.293 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:13:39.314 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:39.306+0000 7f4377c6d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:13:39.316 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:39.306+0000 7f4377c6d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:13:39.317 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:39.310+0000 7f4377c6d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:13:39.489 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:13:39.489 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:13:39.489 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:13:39.489 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:13:39.489 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:13:39.489 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:13:39.489 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:13:39.490 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:13:39.490 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:13:39.490 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:13:39.682 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:13:40.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:13:40.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:13:40.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:13:40.684 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:13:40.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:13:40.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:13:40.814 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:40.810+0000 7f4377c6d8c0 -1 Falling back to public interface 2026-02-17T08:13:40.878 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:13:41.879 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:13:41.880 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:13:41.880 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:13:41.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:13:41.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:13:41.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:13:42.070 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:13:43.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:13:43.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:13:43.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:13:43.073 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:13:43.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:13:43.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:13:43.275 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:13:43.863 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:43.858+0000 7f4377c6d8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:13:44.276 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:13:44.276 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:13:44.277 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:13:44.277 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:13:44.277 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:13:44.277 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:13:44.474 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:13:45.475 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:13:45.475 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:13:45.475 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:13:45.476 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:13:45.476 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:13:45.476 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:13:45.681 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3602143809,v1:127.0.0.1:6803/3602143809] [v2:127.0.0.1:6804/3602143809,v1:127.0.0.1:6805/3602143809] exists,up da982f19-dc77-453f-b3f2-eec4b4e9bb7f 2026-02-17T08:13:45.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:13:45.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:13:45.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:13:45.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:97: TEST_ec_profile_warning: for id in $(seq 0 2) 2026-02-17T08:13:45.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:98: TEST_ec_profile_warning: run_osd td/test-erasure-code-plugins 1 2026-02-17T08:13:45.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code-plugins 2026-02-17T08:13:45.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:13:45.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T08:13:45.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:13:45.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code-plugins/1 2026-02-17T08:13:45.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-17T08:13:45.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:13:45.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:13:45.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:13:45.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/1' 2026-02-17T08:13:45.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/1/journal' 2026-02-17T08:13:45.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:13:45.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:13:45.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-17T08:13:45.687 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:13:45.687 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:13:45.687 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:13:45.687 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:13:45.687 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:13:45.687 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:13:45.687 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:13:45.687 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:13:45.687 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:13:45.687 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:13:45.687 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:13:45.687 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-17T08:13:45.688 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-17T08:13:45.688 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:13:45.688 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:13:45.688 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:13:45.688 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:13:45.688 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:13:45.688 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:13:45.688 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code-plugins/1 2026-02-17T08:13:45.688 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:13:45.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=057d30c5-d06a-4681-a111-e219d6a43c86 2026-02-17T08:13:45.689 INFO:tasks.workunit.client.0.trial059.stdout:add osd1 057d30c5-d06a-4681-a111-e219d6a43c86 2026-02-17T08:13:45.690 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 057d30c5-d06a-4681-a111-e219d6a43c86' 2026-02-17T08:13:45.690 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:13:45.698 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQA5I5Rph09iKRAAvexAXE2lzmu1i7QoMqo2XQ== 2026-02-17T08:13:45.698 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQA5I5Rph09iKRAAvexAXE2lzmu1i7QoMqo2XQ=="}' 2026-02-17T08:13:45.698 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 057d30c5-d06a-4681-a111-e219d6a43c86 -i td/test-erasure-code-plugins/1/new.json 2026-02-17T08:13:45.899 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:13:45.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code-plugins/1/new.json 2026-02-17T08:13:45.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/1 --osd-journal=td/test-erasure-code-plugins/1/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA5I5Rph09iKRAAvexAXE2lzmu1i7QoMqo2XQ== --osd-uuid 057d30c5-d06a-4681-a111-e219d6a43c86 2026-02-17T08:13:45.923 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:45.918+0000 7f82b927f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:13:45.925 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:45.922+0000 7f82b927f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:13:45.926 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:45.922+0000 7f82b927f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:13:45.926 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:45.922+0000 7f82b927f8c0 -1 bdev(0x55c2ec1cbc00 td/test-erasure-code-plugins/1/block) open stat got: (1) Operation not permitted 2026-02-17T08:13:45.926 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:45.922+0000 7f82b927f8c0 -1 bluestore(td/test-erasure-code-plugins/1) _read_fsid unparsable uuid 2026-02-17T08:13:48.198 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code-plugins/1/keyring 2026-02-17T08:13:48.198 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:13:48.199 INFO:tasks.workunit.client.0.trial059.stdout:adding osd1 key to auth repository 2026-02-17T08:13:48.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T08:13:48.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code-plugins/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:13:48.467 INFO:tasks.workunit.client.0.trial059.stdout:start osd.1 2026-02-17T08:13:48.468 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T08:13:48.468 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/1 --osd-journal=td/test-erasure-code-plugins/1/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:13:48.469 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:13:48.469 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:13:48.469 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:13:48.489 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:48.481+0000 7f53d66cc8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:13:48.490 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:48.485+0000 7f53d66cc8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:13:48.491 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:48.485+0000 7f53d66cc8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:13:48.666 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T08:13:48.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:13:48.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:13:48.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:13:48.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:13:48.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:13:48.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:13:48.667 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:13:48.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:13:48.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:13:48.860 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:13:49.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:13:49.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:13:49.862 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:13:49.863 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:13:49.863 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:13:49.863 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:13:50.031 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:50.025+0000 7f53d66cc8c0 -1 Falling back to public interface 2026-02-17T08:13:50.054 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:13:51.056 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:13:51.056 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:13:51.056 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:13:51.056 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:13:51.057 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:13:51.057 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:13:51.255 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:13:52.256 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:13:52.256 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:13:52.257 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:13:52.257 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:13:52.257 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:13:52.257 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:13:52.449 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:13:53.058 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:53.053+0000 7f53d66cc8c0 -1 osd.1 0 log_to_monitors true 2026-02-17T08:13:53.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:13:53.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:13:53.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:13:53.452 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:13:53.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:13:53.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:13:53.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:13:54.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:13:54.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:13:54.649 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:13:54.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:13:54.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:13:54.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:13:54.839 INFO:tasks.workunit.client.0.trial059.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2948719673,v1:127.0.0.1:6811/2948719673] [v2:127.0.0.1:6812/2948719673,v1:127.0.0.1:6813/2948719673] exists,up 057d30c5-d06a-4681-a111-e219d6a43c86 2026-02-17T08:13:54.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:13:54.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:13:54.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:13:54.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:97: TEST_ec_profile_warning: for id in $(seq 0 2) 2026-02-17T08:13:54.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:98: TEST_ec_profile_warning: run_osd td/test-erasure-code-plugins 2 2026-02-17T08:13:54.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code-plugins 2026-02-17T08:13:54.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:13:54.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T08:13:54.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:13:54.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code-plugins/2 2026-02-17T08:13:54.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-17T08:13:54.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:13:54.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:13:54.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:13:54.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/2' 2026-02-17T08:13:54.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/2/journal' 2026-02-17T08:13:54.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:13:54.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:13:54.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-17T08:13:54.844 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:13:54.844 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:13:54.844 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:13:54.844 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:13:54.844 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:13:54.844 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:13:54.844 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:13:54.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:13:54.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:13:54.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:13:54.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:13:54.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-17T08:13:54.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-17T08:13:54.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:13:54.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:13:54.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:13:54.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:13:54.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:13:54.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:13:54.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code-plugins/2 2026-02-17T08:13:54.846 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:13:54.846 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=5e916bca-5d3d-48a4-a35f-7f93e6394fce 2026-02-17T08:13:54.846 INFO:tasks.workunit.client.0.trial059.stdout:add osd2 5e916bca-5d3d-48a4-a35f-7f93e6394fce 2026-02-17T08:13:54.847 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 5e916bca-5d3d-48a4-a35f-7f93e6394fce' 2026-02-17T08:13:54.847 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:13:54.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBCI5Rp/BXEMhAA/zBf1ftR4V4QzfR0QHqHeA== 2026-02-17T08:13:54.856 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBCI5Rp/BXEMhAA/zBf1ftR4V4QzfR0QHqHeA=="}' 2026-02-17T08:13:54.856 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 5e916bca-5d3d-48a4-a35f-7f93e6394fce -i td/test-erasure-code-plugins/2/new.json 2026-02-17T08:13:55.049 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:13:55.058 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code-plugins/2/new.json 2026-02-17T08:13:55.058 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/2 --osd-journal=td/test-erasure-code-plugins/2/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBCI5Rp/BXEMhAA/zBf1ftR4V4QzfR0QHqHeA== --osd-uuid 5e916bca-5d3d-48a4-a35f-7f93e6394fce 2026-02-17T08:13:55.073 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:55.069+0000 7fb5d1cdf8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:13:55.074 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:55.069+0000 7fb5d1cdf8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:13:55.075 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:55.069+0000 7fb5d1cdf8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:13:55.076 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:55.069+0000 7fb5d1cdf8c0 -1 bdev(0x561f66e67c00 td/test-erasure-code-plugins/2/block) open stat got: (1) Operation not permitted 2026-02-17T08:13:55.076 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:55.069+0000 7fb5d1cdf8c0 -1 bluestore(td/test-erasure-code-plugins/2) _read_fsid unparsable uuid 2026-02-17T08:13:57.346 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code-plugins/2/keyring 2026-02-17T08:13:57.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:13:57.347 INFO:tasks.workunit.client.0.trial059.stdout:adding osd2 key to auth repository 2026-02-17T08:13:57.348 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T08:13:57.348 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code-plugins/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:13:57.613 INFO:tasks.workunit.client.0.trial059.stdout:start osd.2 2026-02-17T08:13:57.614 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T08:13:57.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/2 --osd-journal=td/test-erasure-code-plugins/2/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:13:57.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:13:57.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:13:57.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:13:57.629 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:57.621+0000 7f4a408bb8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:13:57.630 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:57.625+0000 7f4a408bb8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:13:57.631 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:57.625+0000 7f4a408bb8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:13:57.813 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T08:13:57.813 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:13:57.813 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:13:57.813 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:13:57.813 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:13:57.813 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:13:57.814 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:13:57.814 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:13:57.814 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:13:57.815 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:13:58.009 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:13:59.010 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:13:59.010 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:13:59.011 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:13:59.011 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:13:59.011 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:13:59.012 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:13:59.139 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:13:59.133+0000 7f4a408bb8c0 -1 Falling back to public interface 2026-02-17T08:13:59.201 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:00.203 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:00.203 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:00.203 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:14:00.203 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:14:00.204 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:00.204 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:14:00.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:01.399 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:01.399 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:01.400 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:14:01.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:14:01.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:01.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:14:01.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:02.128 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:02.121+0000 7f4a408bb8c0 -1 osd.2 0 log_to_monitors true 2026-02-17T08:14:02.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:02.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:02.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:14:02.593 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:14:02.594 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:02.594 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:14:02.786 INFO:tasks.workunit.client.0.trial059.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/4017818124,v1:127.0.0.1:6819/4017818124] [v2:127.0.0.1:6820/4017818124,v1:127.0.0.1:6821/4017818124] exists,up 5e916bca-5d3d-48a4-a35f-7f93e6394fce 2026-02-17T08:14:02.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:14:02.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:14:02.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:14:02.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:100: TEST_ec_profile_warning: create_rbd_pool 2026-02-17T08:14:02.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T08:14:02.971 INFO:tasks.workunit.client.0.trial059.stderr:pool 'rbd' does not exist 2026-02-17T08:14:02.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2026-02-17T08:14:02.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T08:14:03.226 INFO:tasks.workunit.client.0.trial059.stderr:pool 'rbd' already exists 2026-02-17T08:14:03.234 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:14:04.236 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2026-02-17T08:14:04.517 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:101: TEST_ec_profile_warning: wait_for_clean 2026-02-17T08:14:04.517 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:14:04.518 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:14:04.518 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:14:04.519 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:14:04.519 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:14:04.519 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:14:04.519 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:14:04.519 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:14:04.519 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:14:04.617 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:14:04.617 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:14:04.617 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:14:04.617 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:14:04.617 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:14:04.618 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:14:04.814 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:14:04.814 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:14:04.814 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:14:04.814 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:14:04.814 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:14:04.814 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:14:04.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836486 2026-02-17T08:14:04.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836486 2026-02-17T08:14:04.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836486' 2026-02-17T08:14:04.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:14:04.886 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:14:04.962 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705669 2026-02-17T08:14:04.962 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705669 2026-02-17T08:14:04.963 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836486 1-38654705669' 2026-02-17T08:14:04.963 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:14:04.963 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:14:05.035 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=55834574851 2026-02-17T08:14:05.035 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 55834574851 2026-02-17T08:14:05.035 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836486 1-38654705669 2-55834574851' 2026-02-17T08:14:05.035 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:14:05.036 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836486 2026-02-17T08:14:05.036 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:14:05.037 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:14:05.037 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836486 2026-02-17T08:14:05.038 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:14:05.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836486 2026-02-17T08:14:05.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836486' 2026-02-17T08:14:05.039 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 21474836486 2026-02-17T08:14:05.040 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:14:05.237 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836484 -lt 21474836486 2026-02-17T08:14:05.237 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:14:06.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:14:06.238 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:14:06.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836484 -lt 21474836486 2026-02-17T08:14:06.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:14:07.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T08:14:07.436 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:14:07.628 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836487 -lt 21474836486 2026-02-17T08:14:07.628 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:14:07.629 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705669 2026-02-17T08:14:07.629 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:14:07.630 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:14:07.631 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705669 2026-02-17T08:14:07.631 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:14:07.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705669 2026-02-17T08:14:07.633 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 38654705669 2026-02-17T08:14:07.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705669' 2026-02-17T08:14:07.633 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:14:07.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705669 -lt 38654705669 2026-02-17T08:14:07.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:14:07.825 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-55834574851 2026-02-17T08:14:07.826 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:14:07.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:14:07.827 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-55834574851 2026-02-17T08:14:07.827 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:14:07.828 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=55834574851 2026-02-17T08:14:07.828 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 55834574851' 2026-02-17T08:14:07.829 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 55834574851 2026-02-17T08:14:07.829 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:14:08.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 55834574851 -lt 55834574851 2026-02-17T08:14:08.028 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:14:08.028 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:14:08.028 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:14:08.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 == 0 2026-02-17T08:14:08.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:14:08.290 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:14:08.290 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:14:08.291 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:14:08.291 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:14:08.291 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:14:08.291 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:14:08.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=4 2026-02-17T08:14:08.480 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:14:08.480 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:14:08.480 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:14:08.732 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 4 = 4 2026-02-17T08:14:08.732 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:14:08.733 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:14:08.733 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:103: TEST_ec_profile_warning: for plugin in ${legacy_jerasure_plugins[*]} 2026-02-17T08:14:08.733 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:104: TEST_ec_profile_warning: ceph osd erasure-code-profile set prof-jerasure_generic crush-failure-domain=osd technique=reed_sol_van plugin=jerasure_generic 2026-02-17T08:14:08.994 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: get_asok_path mon.a 2026-02-17T08:14:08.994 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:14:08.994 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:14:08.994 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:08.994 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:08.994 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:08.994 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:14:08.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: CEPH_ARGS= 2026-02-17T08:14:08.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-mon.a.asok log flush 2026-02-17T08:14:09.044 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:14:09.049 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:106: TEST_ec_profile_warning: grep 'WARNING: erasure coding profile prof-jerasure_generic uses plugin jerasure_generic' td/test-erasure-code-plugins/mon.a.log 2026-02-17T08:14:09.052 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:14:08.873+0000 7fb0a244f640 0 mon.a@0(leader).osd e20 WARNING: erasure coding profile prof-jerasure_generic uses plugin jerasure_generic that has been deprecated. Please use jerasure instead. 2026-02-17T08:14:09.052 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:14:08.977+0000 7fb0a244f640 0 mon.a@0(leader).osd e21 WARNING: erasure coding profile prof-jerasure_generic uses plugin jerasure_generic that has been deprecated. Please use jerasure instead. 2026-02-17T08:14:09.052 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:14:08.977+0000 7fb0a244f640 0 mon.a@0(leader).osd e21 WARNING: erasure coding profile prof-jerasure_generic uses plugin jerasure_generic that has been deprecated. Please use jerasure instead. 2026-02-17T08:14:09.052 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:103: TEST_ec_profile_warning: for plugin in ${legacy_jerasure_plugins[*]} 2026-02-17T08:14:09.052 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:104: TEST_ec_profile_warning: ceph osd erasure-code-profile set prof-jerasure_sse3 crush-failure-domain=osd technique=reed_sol_van plugin=jerasure_sse3 2026-02-17T08:14:09.308 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: get_asok_path mon.a 2026-02-17T08:14:09.308 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:14:09.308 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:14:09.308 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:09.309 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:09.309 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:09.309 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:14:09.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: CEPH_ARGS= 2026-02-17T08:14:09.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-mon.a.asok log flush 2026-02-17T08:14:09.357 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:14:09.363 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:106: TEST_ec_profile_warning: grep 'WARNING: erasure coding profile prof-jerasure_sse3 uses plugin jerasure_sse3' td/test-erasure-code-plugins/mon.a.log 2026-02-17T08:14:09.365 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:14:09.189+0000 7fb0a244f640 0 mon.a@0(leader).osd e21 WARNING: erasure coding profile prof-jerasure_sse3 uses plugin jerasure_sse3 that has been deprecated. Please use jerasure instead. 2026-02-17T08:14:09.366 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:14:09.289+0000 7fb0a244f640 0 mon.a@0(leader).osd e22 WARNING: erasure coding profile prof-jerasure_sse3 uses plugin jerasure_sse3 that has been deprecated. Please use jerasure instead. 2026-02-17T08:14:09.366 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:14:09.289+0000 7fb0a244f640 0 mon.a@0(leader).osd e22 WARNING: erasure coding profile prof-jerasure_sse3 uses plugin jerasure_sse3 that has been deprecated. Please use jerasure instead. 2026-02-17T08:14:09.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:103: TEST_ec_profile_warning: for plugin in ${legacy_jerasure_plugins[*]} 2026-02-17T08:14:09.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:104: TEST_ec_profile_warning: ceph osd erasure-code-profile set prof-jerasure_sse4 crush-failure-domain=osd technique=reed_sol_van plugin=jerasure_sse4 2026-02-17T08:14:09.634 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: get_asok_path mon.a 2026-02-17T08:14:09.634 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:14:09.634 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:14:09.634 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:09.634 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:09.634 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:09.634 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:14:09.635 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: CEPH_ARGS= 2026-02-17T08:14:09.635 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:105: TEST_ec_profile_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-mon.a.asok log flush 2026-02-17T08:14:09.684 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:14:09.690 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:106: TEST_ec_profile_warning: grep 'WARNING: erasure coding profile prof-jerasure_sse4 uses plugin jerasure_sse4' td/test-erasure-code-plugins/mon.a.log 2026-02-17T08:14:09.692 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:14:09.505+0000 7fb0a244f640 0 mon.a@0(leader).osd e22 WARNING: erasure coding profile prof-jerasure_sse4 uses plugin jerasure_sse4 that has been deprecated. Please use jerasure instead. 2026-02-17T08:14:09.693 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:14:09.613+0000 7fb0a244f640 0 mon.a@0(leader).osd e23 WARNING: erasure coding profile prof-jerasure_sse4 uses plugin jerasure_sse4 that has been deprecated. Please use jerasure instead. 2026-02-17T08:14:09.693 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:14:09.613+0000 7fb0a244f640 0 mon.a@0(leader).osd e23 WARNING: erasure coding profile prof-jerasure_sse4 uses plugin jerasure_sse4 that has been deprecated. Please use jerasure instead. 2026-02-17T08:14:09.693 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:109: TEST_ec_profile_warning: for plugin in ${legacy_shec_plugins[*]} 2026-02-17T08:14:09.693 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:110: TEST_ec_profile_warning: ceph osd erasure-code-profile set prof-shec_generic crush-failure-domain=osd plugin=shec_generic 2026-02-17T08:14:09.953 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: get_asok_path mon.a 2026-02-17T08:14:09.953 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:14:09.953 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:14:09.954 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:09.954 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:09.954 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:09.954 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:14:09.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: CEPH_ARGS= 2026-02-17T08:14:09.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-mon.a.asok log flush 2026-02-17T08:14:10.003 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:14:10.009 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:112: TEST_ec_profile_warning: grep 'WARNING: erasure coding profile prof-shec_generic uses plugin shec_generic' td/test-erasure-code-plugins/mon.a.log 2026-02-17T08:14:10.012 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:14:09.833+0000 7fb0a244f640 0 mon.a@0(leader).osd e23 WARNING: erasure coding profile prof-shec_generic uses plugin shec_generic that has been deprecated. Please use shec instead. 2026-02-17T08:14:10.012 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:14:09.937+0000 7fb0a244f640 0 mon.a@0(leader).osd e24 WARNING: erasure coding profile prof-shec_generic uses plugin shec_generic that has been deprecated. Please use shec instead. 2026-02-17T08:14:10.013 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:14:09.937+0000 7fb0a244f640 0 mon.a@0(leader).osd e24 WARNING: erasure coding profile prof-shec_generic uses plugin shec_generic that has been deprecated. Please use shec instead. 2026-02-17T08:14:10.013 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:109: TEST_ec_profile_warning: for plugin in ${legacy_shec_plugins[*]} 2026-02-17T08:14:10.013 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:110: TEST_ec_profile_warning: ceph osd erasure-code-profile set prof-shec_sse3 crush-failure-domain=osd plugin=shec_sse3 2026-02-17T08:14:10.269 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: get_asok_path mon.a 2026-02-17T08:14:10.270 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:14:10.270 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:14:10.270 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:10.270 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:10.270 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:10.271 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:14:10.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: CEPH_ARGS= 2026-02-17T08:14:10.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-mon.a.asok log flush 2026-02-17T08:14:10.320 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:14:10.326 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:112: TEST_ec_profile_warning: grep 'WARNING: erasure coding profile prof-shec_sse3 uses plugin shec_sse3' td/test-erasure-code-plugins/mon.a.log 2026-02-17T08:14:10.328 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:14:10.149+0000 7fb0a244f640 0 mon.a@0(leader).osd e24 WARNING: erasure coding profile prof-shec_sse3 uses plugin shec_sse3 that has been deprecated. Please use shec instead. 2026-02-17T08:14:10.328 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:14:10.253+0000 7fb0a244f640 0 mon.a@0(leader).osd e25 WARNING: erasure coding profile prof-shec_sse3 uses plugin shec_sse3 that has been deprecated. Please use shec instead. 2026-02-17T08:14:10.329 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:14:10.253+0000 7fb0a244f640 0 mon.a@0(leader).osd e25 WARNING: erasure coding profile prof-shec_sse3 uses plugin shec_sse3 that has been deprecated. Please use shec instead. 2026-02-17T08:14:10.329 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:109: TEST_ec_profile_warning: for plugin in ${legacy_shec_plugins[*]} 2026-02-17T08:14:10.329 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:110: TEST_ec_profile_warning: ceph osd erasure-code-profile set prof-shec_sse4 crush-failure-domain=osd plugin=shec_sse4 2026-02-17T08:14:10.586 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: get_asok_path mon.a 2026-02-17T08:14:10.586 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:14:10.586 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:14:10.586 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:10.586 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:10.586 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:10.586 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:14:10.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: CEPH_ARGS= 2026-02-17T08:14:10.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:111: TEST_ec_profile_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-mon.a.asok log flush 2026-02-17T08:14:10.636 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:14:10.642 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:112: TEST_ec_profile_warning: grep 'WARNING: erasure coding profile prof-shec_sse4 uses plugin shec_sse4' td/test-erasure-code-plugins/mon.a.log 2026-02-17T08:14:10.644 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:14:10.465+0000 7fb0a244f640 0 mon.a@0(leader).osd e25 WARNING: erasure coding profile prof-shec_sse4 uses plugin shec_sse4 that has been deprecated. Please use shec instead. 2026-02-17T08:14:10.644 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:14:10.569+0000 7fb0a244f640 0 mon.a@0(leader).osd e26 WARNING: erasure coding profile prof-shec_sse4 uses plugin shec_sse4 that has been deprecated. Please use shec instead. 2026-02-17T08:14:10.644 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:14:10.569+0000 7fb0a244f640 0 mon.a@0(leader).osd e26 WARNING: erasure coding profile prof-shec_sse4 uses plugin shec_sse4 that has been deprecated. Please use shec instead. 2026-02-17T08:14:10.645 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:115: TEST_ec_profile_warning: teardown td/test-erasure-code-plugins 2026-02-17T08:14:10.645 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:10.645 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:14:10.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:14:10.646 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:14:10.646 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:14:10.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:14:10.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:14:10.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:14:10.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:14:10.754 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:14:10.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:14:10.755 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:14:10.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:14:10.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:14:10.756 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:14:10.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:14:10.757 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:14:10.757 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:14:10.757 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:14:10.758 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:14:10.759 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:14:10.759 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:14:10.770 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:14:10.770 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:10.770 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:10.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:14:10.772 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:14:10.772 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:14:10.772 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:35: run: for func in $funcs 2026-02-17T08:14:10.772 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:36: run: TEST_preload_no_warning td/test-erasure-code-plugins 2026-02-17T08:14:10.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:58: TEST_preload_no_warning: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:10.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:60: TEST_preload_no_warning: for plugin in ${plugins[*]} 2026-02-17T08:14:10.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:61: TEST_preload_no_warning: setup td/test-erasure-code-plugins 2026-02-17T08:14:10.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:10.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-code-plugins 2026-02-17T08:14:10.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:10.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:14:10.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:14:10.773 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:14:10.773 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:14:10.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:14:10.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:14:10.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:14:10.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:14:10.774 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:14:10.775 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:14:10.775 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:14:10.776 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:14:10.776 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:14:10.776 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:14:10.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:14:10.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:14:10.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:14:10.778 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:14:10.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:14:10.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:14:10.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:14:10.781 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:14:10.781 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:10.782 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:10.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:14:10.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:14:10.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:14:10.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-code-plugins 2026-02-17T08:14:10.784 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:14:10.784 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:10.784 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:10.785 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.11805 2026-02-17T08:14:10.786 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:14:10.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:14:10.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:14:10.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-17T08:14:10.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:62: TEST_preload_no_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=jerasure 2026-02-17T08:14:10.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:10.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:14:10.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:14:10.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:14:10.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-17T08:14:10.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=jerasure 2026-02-17T08:14:10.808 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:14:10.809 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:14:10.809 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:14:10.809 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:14:10.809 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:10.809 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:10.809 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:14:10.809 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=jerasure 2026-02-17T08:14:10.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:14:10.835 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:14:10.835 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:14:10.835 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:14:10.835 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:14:10.837 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:14:10.837 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:14:10.838 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:14:10.838 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:14:10.838 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:10.838 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:10.838 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:10.838 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:14:10.838 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:14:10.838 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11805/ceph-mon.a.asok config get fsid 2026-02-17T08:14:10.893 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:14:10.894 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:14:10.894 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:14:10.894 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:14:10.894 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:14:10.894 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:14:10.894 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:14:10.894 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:14:10.894 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:10.894 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:10.895 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:10.895 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:14:10.895 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:14:10.895 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11805/ceph-mon.a.asok config get mon_host 2026-02-17T08:14:10.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:63: TEST_preload_no_warning: run_mgr td/test-erasure-code-plugins x 2026-02-17T08:14:10.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:10.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:14:10.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:14:10.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:14:10.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-17T08:14:10.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:14:11.057 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:14:11.057 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:14:11.057 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:14:11.057 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:14:11.058 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:11.058 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:11.058 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:14:11.058 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:14:11.059 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:14:11.076 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: get_asok_path mon.a 2026-02-17T08:14:11.076 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:14:11.076 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:14:11.076 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:11.076 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:11.076 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:11.076 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:14:11.077 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: CEPH_ARGS= 2026-02-17T08:14:11.077 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-mon.a.asok log flush 2026-02-17T08:14:11.125 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:14:11.134 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:65: TEST_preload_no_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=jerasure 2026-02-17T08:14:11.134 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:11.134 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:14:11.134 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:14:11.134 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:14:11.134 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-17T08:14:11.134 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-17T08:14:11.135 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:14:11.135 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:14:11.135 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:14:11.135 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-17T08:14:11.135 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-17T08:14:11.135 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:14:11.135 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:14:11.135 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-17T08:14:11.135 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:14:11.135 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:14:11.135 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:14:11.135 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:14:11.136 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:11.136 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:11.136 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:14:11.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:14:11.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:14:11.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:14:11.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:14:11.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-17T08:14:11.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-17T08:14:11.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:14:11.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:14:11.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:14:11.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:14:11.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:14:11.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_erasure_code_plugins=jerasure 2026-02-17T08:14:11.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-17T08:14:11.137 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:14:11.138 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=ebedcad4-ca5c-4a7c-9544-b5d8ce18df1f 2026-02-17T08:14:11.138 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 ebedcad4-ca5c-4a7c-9544-b5d8ce18df1f' 2026-02-17T08:14:11.138 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 ebedcad4-ca5c-4a7c-9544-b5d8ce18df1f 2026-02-17T08:14:11.138 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:14:11.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBTI5Rpvk54CBAAX8LEk/fd9y1JHtsukS5N2Q== 2026-02-17T08:14:11.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBTI5Rpvk54CBAAX8LEk/fd9y1JHtsukS5N2Q=="}' 2026-02-17T08:14:11.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new ebedcad4-ca5c-4a7c-9544-b5d8ce18df1f -i td/test-erasure-code-plugins/0/new.json 2026-02-17T08:14:11.254 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:14:11.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-17T08:14:11.262 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=jerasure --mkfs --key AQBTI5Rpvk54CBAAX8LEk/fd9y1JHtsukS5N2Q== --osd-uuid ebedcad4-ca5c-4a7c-9544-b5d8ce18df1f 2026-02-17T08:14:11.278 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:11.273+0000 7f9bd850a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:11.279 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:11.273+0000 7f9bd850a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:11.280 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:11.273+0000 7f9bd850a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:11.280 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:11.273+0000 7f9bd850a8c0 -1 bdev(0x557bc5ed3c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:14:11.280 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:11.273+0000 7f9bd850a8c0 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-17T08:14:13.895 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-17T08:14:13.895 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:14:13.896 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:14:13.897 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:14:13.897 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:14:14.172 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:14:14.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:14:14.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=jerasure 2026-02-17T08:14:14.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:14:14.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:14:14.174 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:14:14.195 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:14.189+0000 7f6f71e9c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:14.196 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:14.189+0000 7f6f71e9c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:14.197 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:14.189+0000 7f6f71e9c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:14.368 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:14:14.368 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:14:14.369 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:14:14.369 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:14:14.369 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:14:14.369 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:14.369 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:14:14.369 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:14:14.370 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:14.370 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:14.567 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:15.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:15.569 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:15.569 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:14:15.570 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:14:15.570 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:15.570 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:15.675 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:15.669+0000 7f6f71e9c8c0 -1 Falling back to public interface 2026-02-17T08:14:15.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:16.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:16.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:16.767 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:14:16.767 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:14:16.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:16.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:16.963 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:17.964 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:17.964 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:17.965 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:14:17.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:14:17.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:17.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:18.163 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:18.680 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:18.672+0000 7f6f71e9c8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:14:19.164 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:19.165 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:19.165 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:14:19.165 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:14:19.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:19.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:19.362 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/4261620514,v1:127.0.0.1:6803/4261620514] [v2:127.0.0.1:6804/4261620514,v1:127.0.0.1:6805/4261620514] exists,up ebedcad4-ca5c-4a7c-9544-b5d8ce18df1f 2026-02-17T08:14:19.363 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:14:19.363 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:14:19.363 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:14:19.363 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: get_asok_path osd.0 2026-02-17T08:14:19.364 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:14:19.364 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:14:19.364 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:19.364 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:19.364 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:19.365 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-osd.0.asok 2026-02-17T08:14:19.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: CEPH_ARGS= 2026-02-17T08:14:19.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-osd.0.asok log flush 2026-02-17T08:14:19.425 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:14:19.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:67: TEST_preload_no_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin' td/test-erasure-code-plugins/mon.a.log 2026-02-17T08:14:19.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:68: TEST_preload_no_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin' td/test-erasure-code-plugins/osd.0.log 2026-02-17T08:14:19.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:69: TEST_preload_no_warning: teardown td/test-erasure-code-plugins 2026-02-17T08:14:19.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:19.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:14:19.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:14:19.435 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:14:19.436 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:14:19.436 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:14:19.436 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:14:19.436 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:14:19.542 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:14:19.543 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:14:19.544 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:14:19.544 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:14:19.545 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:14:19.545 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:14:19.546 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:14:19.546 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:14:19.547 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:14:19.547 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:14:19.547 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:14:19.548 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:14:19.549 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:14:19.549 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:14:19.554 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:14:19.554 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:19.554 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:19.554 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:14:19.556 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:14:19.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:14:19.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:60: TEST_preload_no_warning: for plugin in ${plugins[*]} 2026-02-17T08:14:19.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:61: TEST_preload_no_warning: setup td/test-erasure-code-plugins 2026-02-17T08:14:19.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:19.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-code-plugins 2026-02-17T08:14:19.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:19.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:14:19.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:14:19.557 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:14:19.557 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:14:19.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:14:19.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:14:19.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:14:19.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:14:19.559 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:14:19.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:14:19.560 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:14:19.561 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:14:19.561 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:14:19.561 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:14:19.562 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:14:19.562 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:14:19.563 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:14:19.563 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:14:19.564 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:14:19.565 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:14:19.565 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:14:19.566 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:14:19.566 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:19.566 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:19.566 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:14:19.567 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:14:19.567 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:14:19.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-code-plugins 2026-02-17T08:14:19.569 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:14:19.569 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:19.569 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:19.569 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.11805 2026-02-17T08:14:19.570 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:14:19.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:14:19.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:14:19.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-17T08:14:19.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:62: TEST_preload_no_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=shec 2026-02-17T08:14:19.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:19.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:14:19.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:14:19.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:14:19.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-17T08:14:19.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=shec 2026-02-17T08:14:19.591 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:14:19.592 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:14:19.592 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:14:19.592 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:14:19.592 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:19.592 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:19.592 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:14:19.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=shec 2026-02-17T08:14:19.617 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:14:19.618 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:14:19.619 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:14:19.619 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:14:19.619 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:14:19.619 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:14:19.620 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:14:19.620 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:14:19.620 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:14:19.620 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:19.620 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:19.620 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:19.621 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:14:19.621 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:14:19.621 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11805/ceph-mon.a.asok config get fsid 2026-02-17T08:14:19.674 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:14:19.674 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:14:19.674 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:14:19.674 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:14:19.674 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:14:19.676 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:14:19.676 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:14:19.676 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:14:19.676 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:19.676 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:19.676 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:19.676 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:14:19.676 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:14:19.676 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11805/ceph-mon.a.asok config get mon_host 2026-02-17T08:14:19.729 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:63: TEST_preload_no_warning: run_mgr td/test-erasure-code-plugins x 2026-02-17T08:14:19.729 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:19.729 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:14:19.729 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:14:19.729 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:14:19.729 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-17T08:14:19.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:14:19.836 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:14:19.836 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:14:19.836 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:14:19.836 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:14:19.836 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:19.836 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:19.836 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:14:19.837 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:14:19.837 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:14:19.856 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: get_asok_path mon.a 2026-02-17T08:14:19.856 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:14:19.857 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:14:19.857 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:19.857 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:19.857 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:19.857 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:14:19.858 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: CEPH_ARGS= 2026-02-17T08:14:19.858 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-mon.a.asok log flush 2026-02-17T08:14:19.907 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:14:19.916 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:65: TEST_preload_no_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=shec 2026-02-17T08:14:19.916 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:19.916 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:14:19.916 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:14:19.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:14:19.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-17T08:14:19.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-17T08:14:19.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:14:19.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:14:19.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:14:19.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-17T08:14:19.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-17T08:14:19.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:14:19.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:14:19.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-17T08:14:19.918 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:14:19.918 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:14:19.918 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:14:19.918 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:14:19.918 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:19.918 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:19.918 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:14:19.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:14:19.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:14:19.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:14:19.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:14:19.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-17T08:14:19.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-17T08:14:19.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:14:19.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:14:19.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:14:19.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:14:19.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:14:19.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_erasure_code_plugins=shec 2026-02-17T08:14:19.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-17T08:14:19.920 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:14:19.920 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=accd0bc7-3c0b-430e-a4f2-035ad8a1a6ee 2026-02-17T08:14:19.920 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 accd0bc7-3c0b-430e-a4f2-035ad8a1a6ee 2026-02-17T08:14:19.921 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 accd0bc7-3c0b-430e-a4f2-035ad8a1a6ee' 2026-02-17T08:14:19.921 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:14:19.927 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBbI5RpO3oFNxAAh474FZngEfzLbDqOQpZTxA== 2026-02-17T08:14:19.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBbI5RpO3oFNxAAh474FZngEfzLbDqOQpZTxA=="}' 2026-02-17T08:14:19.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new accd0bc7-3c0b-430e-a4f2-035ad8a1a6ee -i td/test-erasure-code-plugins/0/new.json 2026-02-17T08:14:20.036 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:14:20.044 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-17T08:14:20.045 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=shec --mkfs --key AQBbI5RpO3oFNxAAh474FZngEfzLbDqOQpZTxA== --osd-uuid accd0bc7-3c0b-430e-a4f2-035ad8a1a6ee 2026-02-17T08:14:20.059 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:20.052+0000 7f21bcb458c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:20.061 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:20.052+0000 7f21bcb458c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:20.062 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:20.056+0000 7f21bcb458c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:20.062 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:20.056+0000 7f21bcb458c0 -1 bdev(0x55ed58a0dc00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:14:20.062 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:20.056+0000 7f21bcb458c0 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-17T08:14:22.894 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-17T08:14:22.894 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:14:22.895 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:14:22.895 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:14:22.896 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:14:23.165 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:14:23.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:14:23.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=shec 2026-02-17T08:14:23.167 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:14:23.167 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:14:23.167 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:14:23.179 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:23.172+0000 7f918dd288c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:23.180 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:23.172+0000 7f918dd288c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:23.181 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:23.172+0000 7f918dd288c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:23.364 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:14:23.364 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:14:23.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:14:23.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:14:23.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:14:23.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:23.365 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:14:23.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:14:23.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:23.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:23.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:24.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:24.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:24.559 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:14:24.560 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:14:24.560 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:24.560 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:24.739 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:24.732+0000 7f918dd288c0 -1 Falling back to public interface 2026-02-17T08:14:24.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:25.751 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:25.751 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:25.751 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:14:25.751 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:14:25.751 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:25.751 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:25.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:26.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:26.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:26.950 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:14:26.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:14:26.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:26.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:27.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:27.779 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:27.772+0000 7f918dd288c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:14:28.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:28.144 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:28.144 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:14:28.145 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:14:28.145 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:28.145 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:28.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:29.340 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:29.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:29.341 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:14:29.342 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:14:29.342 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:29.342 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:29.540 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3496618067,v1:127.0.0.1:6803/3496618067] [v2:127.0.0.1:6804/3496618067,v1:127.0.0.1:6805/3496618067] exists,up accd0bc7-3c0b-430e-a4f2-035ad8a1a6ee 2026-02-17T08:14:29.541 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:14:29.541 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:14:29.542 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:14:29.542 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: get_asok_path osd.0 2026-02-17T08:14:29.542 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:14:29.542 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:14:29.542 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:29.542 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:29.542 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:29.542 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-osd.0.asok 2026-02-17T08:14:29.542 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: CEPH_ARGS= 2026-02-17T08:14:29.542 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-osd.0.asok log flush 2026-02-17T08:14:29.603 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:14:29.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:67: TEST_preload_no_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin' td/test-erasure-code-plugins/mon.a.log 2026-02-17T08:14:29.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:68: TEST_preload_no_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin' td/test-erasure-code-plugins/osd.0.log 2026-02-17T08:14:29.612 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:69: TEST_preload_no_warning: teardown td/test-erasure-code-plugins 2026-02-17T08:14:29.612 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:29.612 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:14:29.612 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:14:29.613 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:14:29.613 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:14:29.613 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:14:29.613 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:14:29.614 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:14:29.721 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:14:29.721 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:14:29.721 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:14:29.722 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:14:29.723 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:14:29.724 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:14:29.724 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:14:29.724 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:14:29.725 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:14:29.725 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:14:29.725 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:14:29.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:14:29.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:14:29.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:14:29.732 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:14:29.732 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:29.732 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:29.732 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:14:29.734 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:14:29.734 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:14:29.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:60: TEST_preload_no_warning: for plugin in ${plugins[*]} 2026-02-17T08:14:29.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:61: TEST_preload_no_warning: setup td/test-erasure-code-plugins 2026-02-17T08:14:29.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:29.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-code-plugins 2026-02-17T08:14:29.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:29.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:14:29.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:14:29.735 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:14:29.735 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:14:29.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:14:29.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:14:29.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:14:29.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:14:29.737 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:14:29.737 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:14:29.738 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:14:29.739 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:14:29.739 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:14:29.739 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:14:29.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:14:29.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:14:29.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:14:29.741 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:14:29.742 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:14:29.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:14:29.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:14:29.744 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:14:29.744 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:29.744 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:29.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:14:29.745 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:14:29.745 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:14:29.745 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-code-plugins 2026-02-17T08:14:29.746 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:14:29.747 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:29.747 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:29.747 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.11805 2026-02-17T08:14:29.748 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:14:29.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:14:29.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:14:29.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-17T08:14:29.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:62: TEST_preload_no_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=lrc 2026-02-17T08:14:29.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:29.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:14:29.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:14:29.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:14:29.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-17T08:14:29.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=lrc 2026-02-17T08:14:29.769 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:14:29.769 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:14:29.769 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:14:29.769 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:14:29.770 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:29.770 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:29.770 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:14:29.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=lrc 2026-02-17T08:14:29.796 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:14:29.797 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:14:29.797 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:14:29.797 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:14:29.797 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:14:29.797 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:14:29.798 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:14:29.798 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:14:29.798 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:14:29.798 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:29.798 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:29.798 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:29.798 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:14:29.799 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:14:29.799 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11805/ceph-mon.a.asok config get fsid 2026-02-17T08:14:29.853 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:14:29.854 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:14:29.854 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:14:29.854 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:14:29.854 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:14:29.855 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:14:29.855 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:14:29.855 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:14:29.856 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:29.856 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:29.856 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:29.856 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:14:29.856 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:14:29.856 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11805/ceph-mon.a.asok config get mon_host 2026-02-17T08:14:29.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:63: TEST_preload_no_warning: run_mgr td/test-erasure-code-plugins x 2026-02-17T08:14:29.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:29.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:14:29.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:14:29.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:14:29.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-17T08:14:29.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:14:30.015 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:14:30.015 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:14:30.015 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:14:30.015 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:14:30.015 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:30.016 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:30.016 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:14:30.016 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:14:30.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:14:30.035 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: get_asok_path mon.a 2026-02-17T08:14:30.035 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:14:30.035 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:14:30.035 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:30.035 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:30.035 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:30.036 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:14:30.036 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: CEPH_ARGS= 2026-02-17T08:14:30.036 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-mon.a.asok log flush 2026-02-17T08:14:30.098 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:14:30.106 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:65: TEST_preload_no_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=lrc 2026-02-17T08:14:30.106 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:30.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:14:30.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:14:30.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:14:30.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-17T08:14:30.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-17T08:14:30.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:14:30.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:14:30.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:14:30.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-17T08:14:30.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-17T08:14:30.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:14:30.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:14:30.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-17T08:14:30.108 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:14:30.108 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:14:30.108 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:14:30.108 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:14:30.108 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:30.108 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:30.108 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:14:30.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:14:30.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:14:30.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:14:30.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:14:30.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-17T08:14:30.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-17T08:14:30.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:14:30.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:14:30.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:14:30.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:14:30.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:14:30.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_erasure_code_plugins=lrc 2026-02-17T08:14:30.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-17T08:14:30.110 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:14:30.110 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=4de4ff1c-ca9d-44a5-b0f7-6e278d28ab34 2026-02-17T08:14:30.110 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 4de4ff1c-ca9d-44a5-b0f7-6e278d28ab34 2026-02-17T08:14:30.111 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 4de4ff1c-ca9d-44a5-b0f7-6e278d28ab34' 2026-02-17T08:14:30.111 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:14:30.118 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBmI5RpgpfFBhAA/IvaIoW8ZvtB2RBxGXvgCw== 2026-02-17T08:14:30.118 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBmI5RpgpfFBhAA/IvaIoW8ZvtB2RBxGXvgCw=="}' 2026-02-17T08:14:30.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 4de4ff1c-ca9d-44a5-b0f7-6e278d28ab34 -i td/test-erasure-code-plugins/0/new.json 2026-02-17T08:14:30.228 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:14:30.235 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-17T08:14:30.237 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=lrc --mkfs --key AQBmI5RpgpfFBhAA/IvaIoW8ZvtB2RBxGXvgCw== --osd-uuid 4de4ff1c-ca9d-44a5-b0f7-6e278d28ab34 2026-02-17T08:14:30.251 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:30.244+0000 7fbace6e88c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:30.253 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:30.244+0000 7fbace6e88c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:30.254 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:30.244+0000 7fbace6e88c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:30.254 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:30.248+0000 7fbace6e88c0 -1 bdev(0x55aaea251c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:14:30.254 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:30.248+0000 7fbace6e88c0 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-17T08:14:33.055 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-17T08:14:33.055 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:14:33.056 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:14:33.056 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:14:33.056 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:14:33.318 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:14:33.319 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:14:33.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=lrc 2026-02-17T08:14:33.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:14:33.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:14:33.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:14:33.340 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:33.332+0000 7fc7a4fb58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:33.342 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:33.332+0000 7fc7a4fb58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:33.343 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:33.336+0000 7fc7a4fb58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:33.517 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:14:33.517 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:14:33.517 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:14:33.517 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:14:33.518 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:14:33.518 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:33.518 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:14:33.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:14:33.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:33.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:33.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:34.714 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:34.714 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:34.715 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:14:34.715 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:14:34.715 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:34.716 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:34.828 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:34.820+0000 7fc7a4fb58c0 -1 Falling back to public interface 2026-02-17T08:14:34.914 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:35.915 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:35.916 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:35.916 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:14:35.916 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:14:35.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:35.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:36.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:37.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:37.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:37.114 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:14:37.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:14:37.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:37.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:37.308 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:37.842 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:37.832+0000 7fc7a4fb58c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:14:38.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:38.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:38.310 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:14:38.310 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:14:38.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:38.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:38.507 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/741432508,v1:127.0.0.1:6803/741432508] [v2:127.0.0.1:6804/741432508,v1:127.0.0.1:6805/741432508] exists,up 4de4ff1c-ca9d-44a5-b0f7-6e278d28ab34 2026-02-17T08:14:38.508 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:14:38.509 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:14:38.509 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:14:38.509 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: get_asok_path osd.0 2026-02-17T08:14:38.509 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:14:38.509 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:14:38.509 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:38.509 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:38.509 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:38.510 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-osd.0.asok 2026-02-17T08:14:38.510 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: CEPH_ARGS= 2026-02-17T08:14:38.510 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-osd.0.asok log flush 2026-02-17T08:14:38.571 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:14:38.576 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:67: TEST_preload_no_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin' td/test-erasure-code-plugins/mon.a.log 2026-02-17T08:14:38.577 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:68: TEST_preload_no_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin' td/test-erasure-code-plugins/osd.0.log 2026-02-17T08:14:38.579 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:69: TEST_preload_no_warning: teardown td/test-erasure-code-plugins 2026-02-17T08:14:38.579 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:38.579 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:14:38.579 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:14:38.580 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:14:38.580 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:14:38.580 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:14:38.580 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:14:38.580 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:14:38.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:14:38.889 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:14:38.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:14:38.891 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:14:38.892 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:14:38.892 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:14:38.893 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:14:38.894 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:14:38.894 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:14:38.895 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:14:38.895 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:14:38.896 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:14:38.897 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:14:38.897 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:14:38.902 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:14:38.902 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:38.902 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:38.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:14:38.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:14:38.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:14:38.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:60: TEST_preload_no_warning: for plugin in ${plugins[*]} 2026-02-17T08:14:38.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:61: TEST_preload_no_warning: setup td/test-erasure-code-plugins 2026-02-17T08:14:38.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:38.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-code-plugins 2026-02-17T08:14:38.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:38.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:14:38.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:14:38.905 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:14:38.905 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:14:38.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:14:38.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:14:38.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:14:38.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:14:38.907 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:14:38.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:14:38.908 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:14:38.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:14:38.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:14:38.909 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:14:38.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:14:38.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:14:38.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:14:38.911 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:14:38.911 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:14:38.912 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:14:38.912 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:14:38.914 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:14:38.914 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:38.914 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:38.914 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:14:38.915 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:14:38.915 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:14:38.915 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-code-plugins 2026-02-17T08:14:38.916 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:14:38.916 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:38.916 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:38.916 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.11805 2026-02-17T08:14:38.918 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:14:38.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:14:38.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:14:38.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-17T08:14:38.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:62: TEST_preload_no_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=isa 2026-02-17T08:14:38.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:38.920 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:14:38.920 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:14:38.920 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:14:38.920 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-17T08:14:38.920 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=isa 2026-02-17T08:14:38.939 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:14:38.939 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:14:38.940 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:14:38.940 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:14:38.940 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:38.940 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:38.940 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:14:38.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=isa 2026-02-17T08:14:38.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:14:38.966 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:14:38.966 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:14:38.966 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:14:38.966 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:14:38.968 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:14:38.968 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:14:38.968 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:14:38.968 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:14:38.968 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:38.968 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:38.968 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:38.968 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:14:38.968 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:14:38.968 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11805/ceph-mon.a.asok config get fsid 2026-02-17T08:14:39.022 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:14:39.022 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:14:39.022 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:14:39.022 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:14:39.022 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:14:39.023 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:14:39.023 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:14:39.024 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:14:39.024 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:39.024 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:39.024 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:39.024 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:14:39.024 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:14:39.024 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11805/ceph-mon.a.asok config get mon_host 2026-02-17T08:14:39.077 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:63: TEST_preload_no_warning: run_mgr td/test-erasure-code-plugins x 2026-02-17T08:14:39.077 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:39.077 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:14:39.077 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:14:39.077 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:14:39.077 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-17T08:14:39.077 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:14:39.183 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:14:39.183 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:14:39.183 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:14:39.183 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:14:39.184 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:39.184 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:39.184 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:14:39.184 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:14:39.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:14:39.203 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: get_asok_path mon.a 2026-02-17T08:14:39.203 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:14:39.203 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:14:39.203 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:39.203 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:39.203 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:39.203 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:14:39.204 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: CEPH_ARGS= 2026-02-17T08:14:39.204 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:64: TEST_preload_no_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-mon.a.asok log flush 2026-02-17T08:14:39.253 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:14:39.260 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:65: TEST_preload_no_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=isa 2026-02-17T08:14:39.260 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:39.260 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:14:39.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:14:39.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:14:39.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-17T08:14:39.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-17T08:14:39.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:14:39.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:14:39.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:14:39.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-17T08:14:39.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-17T08:14:39.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:14:39.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:14:39.262 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-17T08:14:39.262 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:14:39.262 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:14:39.262 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:14:39.262 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:14:39.262 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:39.262 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:39.262 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:14:39.264 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:14:39.264 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:14:39.264 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:14:39.264 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:14:39.264 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-17T08:14:39.264 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-17T08:14:39.264 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:14:39.264 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:14:39.264 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:14:39.264 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:14:39.265 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:14:39.265 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_erasure_code_plugins=isa 2026-02-17T08:14:39.265 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-17T08:14:39.265 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:14:39.265 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=e9f43aa4-55ae-4924-b339-431c334cc7a5 2026-02-17T08:14:39.265 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 e9f43aa4-55ae-4924-b339-431c334cc7a5 2026-02-17T08:14:39.266 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 e9f43aa4-55ae-4924-b339-431c334cc7a5' 2026-02-17T08:14:39.266 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:14:39.274 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBvI5RpM4YOEBAAPHpIfA0Bqp4FN5xiAUNm1A== 2026-02-17T08:14:39.274 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBvI5RpM4YOEBAAPHpIfA0Bqp4FN5xiAUNm1A=="}' 2026-02-17T08:14:39.275 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new e9f43aa4-55ae-4924-b339-431c334cc7a5 -i td/test-erasure-code-plugins/0/new.json 2026-02-17T08:14:39.386 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:14:39.393 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-17T08:14:39.395 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=isa --mkfs --key AQBvI5RpM4YOEBAAPHpIfA0Bqp4FN5xiAUNm1A== --osd-uuid e9f43aa4-55ae-4924-b339-431c334cc7a5 2026-02-17T08:14:39.410 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:39.404+0000 7fc658cce8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:39.412 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:39.404+0000 7fc658cce8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:39.413 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:39.404+0000 7fc658cce8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:39.413 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:39.404+0000 7fc658cce8c0 -1 bdev(0x5589085e7c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:14:39.413 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:39.404+0000 7fc658cce8c0 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-17T08:14:42.019 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-17T08:14:42.019 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:14:42.020 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:14:42.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:14:42.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:14:42.289 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:14:42.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:14:42.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=isa 2026-02-17T08:14:42.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:14:42.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:14:42.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:14:42.311 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:42.304+0000 7f3527f5e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:42.313 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:42.304+0000 7f3527f5e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:42.314 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:42.304+0000 7f3527f5e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:42.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:14:42.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:14:42.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:14:42.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:14:42.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:14:42.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:42.487 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:14:42.487 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:14:42.487 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:42.488 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:42.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:43.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:43.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:43.685 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:14:43.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:14:43.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:43.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:43.796 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:43.788+0000 7f3527f5e8c0 -1 Falling back to public interface 2026-02-17T08:14:43.876 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:44.877 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:44.877 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:44.877 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:14:44.878 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:14:44.878 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:44.878 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:45.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:46.075 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:46.075 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:46.075 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:14:46.076 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:14:46.076 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:46.076 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:46.270 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:46.999 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:46.992+0000 7f3527f5e8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:14:47.272 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:47.272 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:47.272 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:14:47.273 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:14:47.273 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:47.273 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:47.469 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:48.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:48.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:48.472 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:14:48.472 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:14:48.472 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:48.472 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:48.666 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/126579092,v1:127.0.0.1:6803/126579092] [v2:127.0.0.1:6804/126579092,v1:127.0.0.1:6805/126579092] exists,up e9f43aa4-55ae-4924-b339-431c334cc7a5 2026-02-17T08:14:48.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:14:48.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:14:48.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:14:48.668 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: get_asok_path osd.0 2026-02-17T08:14:48.668 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:14:48.668 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:14:48.668 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:48.668 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:48.668 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:48.668 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-osd.0.asok 2026-02-17T08:14:48.669 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: CEPH_ARGS= 2026-02-17T08:14:48.669 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:66: TEST_preload_no_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-osd.0.asok log flush 2026-02-17T08:14:48.726 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:14:48.731 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:67: TEST_preload_no_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin' td/test-erasure-code-plugins/mon.a.log 2026-02-17T08:14:48.733 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:68: TEST_preload_no_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin' td/test-erasure-code-plugins/osd.0.log 2026-02-17T08:14:48.734 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:69: TEST_preload_no_warning: teardown td/test-erasure-code-plugins 2026-02-17T08:14:48.734 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:48.734 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:14:48.734 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:14:48.735 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:14:48.735 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:14:48.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:14:48.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:14:48.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:14:48.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:14:48.843 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:14:48.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:14:48.844 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:14:48.846 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:14:48.846 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:14:48.846 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:14:48.847 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:14:48.847 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:14:48.848 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:14:48.848 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:14:48.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:14:48.850 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:14:48.850 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:14:48.854 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:14:48.854 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:48.855 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:48.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:14:48.857 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:14:48.857 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:14:48.857 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:72: TEST_preload_no_warning: return 0 2026-02-17T08:14:48.857 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:35: run: for func in $funcs 2026-02-17T08:14:48.857 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:36: run: TEST_preload_no_warning_default td/test-erasure-code-plugins 2026-02-17T08:14:48.858 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:76: TEST_preload_no_warning_default: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:48.858 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:78: TEST_preload_no_warning_default: setup td/test-erasure-code-plugins 2026-02-17T08:14:48.858 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:48.858 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-code-plugins 2026-02-17T08:14:48.858 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:48.858 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:14:48.858 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:14:48.858 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:14:48.858 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:14:48.858 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:14:48.858 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:14:48.858 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:14:48.859 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:14:48.859 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:14:48.860 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:14:48.860 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:14:48.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:14:48.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:14:48.861 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:14:48.863 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:14:48.863 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:14:48.863 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:14:48.863 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:14:48.864 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:14:48.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:14:48.866 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:14:48.867 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:14:48.867 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:48.867 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:48.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:14:48.868 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:14:48.869 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:14:48.869 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-code-plugins 2026-02-17T08:14:48.870 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:14:48.870 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:48.870 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:48.870 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.11805 2026-02-17T08:14:48.871 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:14:48.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:14:48.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:14:48.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-17T08:14:48.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:79: TEST_preload_no_warning_default: run_mon td/test-erasure-code-plugins a 2026-02-17T08:14:48.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:48.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:14:48.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:14:48.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:14:48.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-17T08:14:48.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins 2026-02-17T08:14:48.892 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:14:48.892 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:14:48.892 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:14:48.893 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:14:48.893 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:48.893 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:48.893 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:14:48.893 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T08:14:48.920 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:14:48.921 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:14:48.921 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:14:48.921 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:14:48.922 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:14:48.922 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:14:48.923 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:14:48.923 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:14:48.923 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:14:48.923 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:48.923 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:48.923 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:48.923 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:14:48.923 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:14:48.923 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11805/ceph-mon.a.asok config get fsid 2026-02-17T08:14:48.977 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:14:48.978 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:14:48.978 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:14:48.978 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:14:48.978 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:14:48.978 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:14:48.978 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:14:48.978 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:14:48.979 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:48.979 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:48.979 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:48.980 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:14:48.980 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:14:48.980 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11805/ceph-mon.a.asok config get mon_host 2026-02-17T08:14:49.033 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:80: TEST_preload_no_warning_default: get_asok_path mon.a 2026-02-17T08:14:49.033 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:14:49.033 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:14:49.033 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:49.033 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:49.033 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:49.034 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:14:49.034 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:80: TEST_preload_no_warning_default: CEPH_ARGS= 2026-02-17T08:14:49.034 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:80: TEST_preload_no_warning_default: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-mon.a.asok log flush 2026-02-17T08:14:49.088 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:14:49.094 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:81: TEST_preload_no_warning_default: run_mgr td/test-erasure-code-plugins x 2026-02-17T08:14:49.094 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:49.094 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:14:49.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:14:49.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:14:49.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-17T08:14:49.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:14:49.216 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:14:49.217 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:14:49.217 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:14:49.217 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:14:49.217 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:49.217 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:49.218 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:14:49.218 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:14:49.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:14:49.237 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:82: TEST_preload_no_warning_default: run_osd td/test-erasure-code-plugins 0 2026-02-17T08:14:49.237 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:49.237 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:14:49.237 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:14:49.237 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:14:49.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-17T08:14:49.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-17T08:14:49.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:14:49.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:14:49.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:14:49.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-17T08:14:49.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-17T08:14:49.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:14:49.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:14:49.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-17T08:14:49.238 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:14:49.238 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:14:49.239 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:14:49.239 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:14:49.239 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:49.239 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:49.239 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:14:49.239 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:14:49.239 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:14:49.239 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:14:49.239 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:14:49.239 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-17T08:14:49.239 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-17T08:14:49.239 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:14:49.239 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:14:49.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:14:49.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:14:49.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:14:49.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:14:49.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-17T08:14:49.240 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:14:49.241 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=7c4b6944-5606-4808-b5ca-08862ef64f4d 2026-02-17T08:14:49.241 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 7c4b6944-5606-4808-b5ca-08862ef64f4d 2026-02-17T08:14:49.241 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 7c4b6944-5606-4808-b5ca-08862ef64f4d' 2026-02-17T08:14:49.241 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:14:49.250 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQB5I5Rpm7WXDhAAGo/Dfuk+apNHLWtTPfG2/A== 2026-02-17T08:14:49.250 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQB5I5Rpm7WXDhAAGo/Dfuk+apNHLWtTPfG2/A=="}' 2026-02-17T08:14:49.250 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 7c4b6944-5606-4808-b5ca-08862ef64f4d -i td/test-erasure-code-plugins/0/new.json 2026-02-17T08:14:49.359 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:14:49.367 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-17T08:14:49.368 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB5I5Rpm7WXDhAAGo/Dfuk+apNHLWtTPfG2/A== --osd-uuid 7c4b6944-5606-4808-b5ca-08862ef64f4d 2026-02-17T08:14:49.382 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:49.372+0000 7fa4285d18c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:49.384 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:49.376+0000 7fa4285d18c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:49.385 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:49.376+0000 7fa4285d18c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:49.385 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:49.376+0000 7fa4285d18c0 -1 bdev(0x559d173cfc00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:14:49.385 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:49.376+0000 7fa4285d18c0 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-17T08:14:52.191 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-17T08:14:52.191 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:14:52.192 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:14:52.192 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:14:52.193 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:14:52.453 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:14:52.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:14:52.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:14:52.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:14:52.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:14:52.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:14:52.474 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:52.463+0000 7f384b99b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:52.476 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:52.467+0000 7f384b99b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:52.477 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:52.467+0000 7f384b99b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:52.651 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:14:52.651 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:14:52.651 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:14:52.651 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:14:52.651 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:14:52.651 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:52.652 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:14:52.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:14:52.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:52.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:52.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:53.846 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:53.846 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:53.846 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:14:53.846 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:14:53.847 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:53.847 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:53.960 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:53.951+0000 7f384b99b8c0 -1 Falling back to public interface 2026-02-17T08:14:54.035 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:55.036 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:55.036 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:55.037 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:14:55.037 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:14:55.037 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:55.037 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:55.230 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:56.231 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:56.232 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:56.232 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:14:56.233 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:14:56.233 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:56.233 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:56.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:57.174 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:57.163+0000 7f384b99b8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:14:57.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:57.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:57.427 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:14:57.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:14:57.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:57.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:57.618 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:14:58.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:14:58.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:14:58.620 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:14:58.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:14:58.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:14:58.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:14:58.812 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/617145120,v1:127.0.0.1:6803/617145120] [v2:127.0.0.1:6804/617145120,v1:127.0.0.1:6805/617145120] exists,up 7c4b6944-5606-4808-b5ca-08862ef64f4d 2026-02-17T08:14:58.812 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:14:58.812 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:14:58.812 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:14:58.813 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:83: TEST_preload_no_warning_default: get_asok_path osd.0 2026-02-17T08:14:58.813 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:14:58.813 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:14:58.813 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:58.813 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:58.813 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:58.813 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-osd.0.asok 2026-02-17T08:14:58.814 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:83: TEST_preload_no_warning_default: CEPH_ARGS= 2026-02-17T08:14:58.814 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:83: TEST_preload_no_warning_default: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-osd.0.asok log flush 2026-02-17T08:14:58.874 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:14:58.879 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:84: TEST_preload_no_warning_default: grep 'WARNING: osd_erasure_code_plugins' td/test-erasure-code-plugins/mon.a.log 2026-02-17T08:14:58.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:85: TEST_preload_no_warning_default: grep 'WARNING: osd_erasure_code_plugins' td/test-erasure-code-plugins/osd.0.log 2026-02-17T08:14:58.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:86: TEST_preload_no_warning_default: teardown td/test-erasure-code-plugins 2026-02-17T08:14:58.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:58.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:14:58.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:14:58.884 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:14:58.884 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:14:58.884 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:14:58.884 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:14:58.884 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:14:58.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:14:58.992 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:14:58.993 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:14:58.993 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:14:58.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:14:58.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:14:58.995 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:14:58.996 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:14:58.996 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:14:58.996 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:14:58.996 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:14:58.997 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:14:58.998 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:14:58.998 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:14:59.003 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:14:59.003 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:59.003 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:59.003 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:14:59.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:14:59.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:14:59.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:88: TEST_preload_no_warning_default: return 0 2026-02-17T08:14:59.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:35: run: for func in $funcs 2026-02-17T08:14:59.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:36: run: TEST_preload_warning td/test-erasure-code-plugins 2026-02-17T08:14:59.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:41: TEST_preload_warning: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:59.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:43: TEST_preload_warning: for plugin in ${legacy_jerasure_plugins[*]} ${legacy_shec_plugins[*]} 2026-02-17T08:14:59.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:44: TEST_preload_warning: setup td/test-erasure-code-plugins 2026-02-17T08:14:59.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:59.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-code-plugins 2026-02-17T08:14:59.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:59.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:14:59.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:14:59.007 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:14:59.007 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:14:59.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:14:59.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:14:59.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:14:59.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:14:59.008 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:14:59.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:14:59.009 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:14:59.010 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:14:59.010 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:14:59.010 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:14:59.011 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:14:59.011 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:14:59.012 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:14:59.012 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:14:59.013 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:14:59.014 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:14:59.014 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:14:59.015 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:14:59.015 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:59.016 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:59.016 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:14:59.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:14:59.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:14:59.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-code-plugins 2026-02-17T08:14:59.018 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:14:59.018 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:59.018 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:59.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.11805 2026-02-17T08:14:59.020 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:14:59.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:14:59.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:14:59.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-17T08:14:59.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:45: TEST_preload_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=jerasure_generic 2026-02-17T08:14:59.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:59.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:14:59.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:14:59.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:14:59.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-17T08:14:59.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=jerasure_generic 2026-02-17T08:14:59.041 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:14:59.041 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:14:59.041 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:14:59.041 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:14:59.041 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:59.042 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:59.042 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:14:59.042 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=jerasure_generic 2026-02-17T08:14:59.070 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:14:59.071 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:14:59.071 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:14:59.071 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:14:59.071 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:14:59.072 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:14:59.072 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:14:59.072 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:14:59.073 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:14:59.073 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:59.073 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:59.073 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:59.073 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:14:59.073 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:14:59.073 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11805/ceph-mon.a.asok config get fsid 2026-02-17T08:14:59.127 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:14:59.127 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:14:59.127 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:14:59.127 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:14:59.127 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:14:59.128 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:14:59.128 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:14:59.128 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:14:59.129 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:59.129 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:59.129 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:59.129 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:14:59.129 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:14:59.129 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11805/ceph-mon.a.asok config get mon_host 2026-02-17T08:14:59.181 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:46: TEST_preload_warning: run_mgr td/test-erasure-code-plugins x 2026-02-17T08:14:59.182 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:59.182 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:14:59.182 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:14:59.182 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:14:59.182 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-17T08:14:59.182 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:14:59.286 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:14:59.286 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:14:59.286 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:14:59.287 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:14:59.287 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:59.287 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:59.287 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:14:59.288 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:14:59.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:14:59.306 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: get_asok_path mon.a 2026-02-17T08:14:59.306 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:14:59.306 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:14:59.306 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:14:59.306 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:59.306 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:59.307 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:14:59.307 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: CEPH_ARGS= 2026-02-17T08:14:59.307 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-mon.a.asok log flush 2026-02-17T08:14:59.354 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:14:59.364 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:48: TEST_preload_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=jerasure_generic 2026-02-17T08:14:59.364 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code-plugins 2026-02-17T08:14:59.364 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:14:59.364 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:14:59.364 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:14:59.364 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-17T08:14:59.364 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-17T08:14:59.364 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:14:59.364 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:14:59.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:14:59.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-17T08:14:59.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-17T08:14:59.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:14:59.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:14:59.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-17T08:14:59.365 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:14:59.365 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:14:59.365 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:14:59.365 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:14:59.365 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:14:59.365 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:14:59.366 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:14:59.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:14:59.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:14:59.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:14:59.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:14:59.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-17T08:14:59.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-17T08:14:59.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:14:59.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:14:59.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:14:59.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:14:59.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:14:59.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_erasure_code_plugins=jerasure_generic 2026-02-17T08:14:59.367 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-17T08:14:59.367 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:14:59.367 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=455d0c58-946d-453e-ba39-8a13456a31cc 2026-02-17T08:14:59.367 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 455d0c58-946d-453e-ba39-8a13456a31cc 2026-02-17T08:14:59.368 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 455d0c58-946d-453e-ba39-8a13456a31cc' 2026-02-17T08:14:59.368 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:14:59.376 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCDI5RpabcMFhAAt3zZaTHIi5MbNvvAiZpNVg== 2026-02-17T08:14:59.376 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCDI5RpabcMFhAAt3zZaTHIi5MbNvvAiZpNVg=="}' 2026-02-17T08:14:59.376 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 455d0c58-946d-453e-ba39-8a13456a31cc -i td/test-erasure-code-plugins/0/new.json 2026-02-17T08:14:59.486 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:14:59.494 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-17T08:14:59.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=jerasure_generic --mkfs --key AQCDI5RpabcMFhAAt3zZaTHIi5MbNvvAiZpNVg== --osd-uuid 455d0c58-946d-453e-ba39-8a13456a31cc 2026-02-17T08:14:59.510 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:59.499+0000 7f298aeae8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:59.512 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:59.503+0000 7f298aeae8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:59.513 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:59.503+0000 7f298aeae8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:14:59.513 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:59.503+0000 7f298aeae8c0 -1 bdev(0x5596be101c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:14:59.513 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:14:59.503+0000 7f298aeae8c0 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-17T08:15:02.104 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-17T08:15:02.104 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:15:02.105 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:15:02.105 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:15:02.105 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:15:02.370 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:15:02.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:15:02.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=jerasure_generic 2026-02-17T08:15:02.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:15:02.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:15:02.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:15:02.393 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:02.383+0000 7fa7ed66e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:02.394 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:02.383+0000 7fa7ed66e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:02.396 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:02.387+0000 7fa7ed66e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:02.570 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:15:02.570 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:15:02.570 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:15:02.570 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:15:02.570 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:15:02.570 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:02.571 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:15:02.571 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:15:02.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:02.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:02.763 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:03.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:03.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:03.766 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:15:03.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:15:03.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:03.767 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:03.904 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:03.895+0000 7fa7ed66e8c0 -1 Falling back to public interface 2026-02-17T08:15:03.955 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:04.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:04.957 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:04.957 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:15:04.957 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:15:04.957 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:04.958 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:05.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:06.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:06.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:06.151 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:15:06.151 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:15:06.151 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:06.151 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:06.346 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:06.876 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:06.867+0000 7fa7ed66e8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:15:07.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:07.348 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:07.348 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:15:07.348 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:15:07.348 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:07.349 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:07.546 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2940163499,v1:127.0.0.1:6803/2940163499] [v2:127.0.0.1:6804/2940163499,v1:127.0.0.1:6805/2940163499] exists,up 455d0c58-946d-453e-ba39-8a13456a31cc 2026-02-17T08:15:07.549 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:15:07.549 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:15:07.549 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:15:07.550 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: get_asok_path osd.0 2026-02-17T08:15:07.550 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:15:07.550 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:15:07.550 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:15:07.550 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:07.550 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:07.551 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-osd.0.asok 2026-02-17T08:15:07.551 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: CEPH_ARGS= 2026-02-17T08:15:07.551 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-osd.0.asok log flush 2026-02-17T08:15:07.610 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:15:07.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:50: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin jerasure_generic' td/test-erasure-code-plugins/mon.a.log 2026-02-17T08:15:07.616 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:14:59.047+0000 7ff81ebf0ec0 0 WARNING: osd_erasure_code_plugins contains plugin jerasure_generic that is now deprecated. Please modify the value for osd_erasure_code_plugins to use jerasure instead. 2026-02-17T08:15:07.617 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:51: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin jerasure_generic' td/test-erasure-code-plugins/osd.0.log 2026-02-17T08:15:07.618 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:15:03.895+0000 7fa7ed66e8c0 0 WARNING: osd_erasure_code_plugins contains plugin jerasure_generic that is now deprecated. Please modify the value for osd_erasure_code_plugins to use jerasure instead. 2026-02-17T08:15:07.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:52: TEST_preload_warning: teardown td/test-erasure-code-plugins 2026-02-17T08:15:07.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:07.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:15:07.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:15:07.619 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:15:07.619 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:15:07.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:15:07.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:15:07.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:15:07.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:15:07.727 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:15:07.728 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:15:07.729 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:15:07.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:15:07.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:15:07.730 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:15:07.731 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:07.731 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:15:07.731 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:15:07.731 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:07.733 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:15:07.734 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:15:07.734 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:15:07.738 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:15:07.738 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:07.738 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:07.738 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:15:07.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:15:07.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:15:07.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:43: TEST_preload_warning: for plugin in ${legacy_jerasure_plugins[*]} ${legacy_shec_plugins[*]} 2026-02-17T08:15:07.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:44: TEST_preload_warning: setup td/test-erasure-code-plugins 2026-02-17T08:15:07.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:07.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-code-plugins 2026-02-17T08:15:07.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:07.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:15:07.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:15:07.740 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:15:07.740 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:15:07.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:15:07.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:15:07.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:15:07.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:15:07.743 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:15:07.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:15:07.744 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:15:07.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:15:07.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:15:07.746 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:15:07.747 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:07.747 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:15:07.747 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:15:07.748 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:07.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:15:07.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:15:07.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:15:07.751 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:15:07.751 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:07.751 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:07.751 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:15:07.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:15:07.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:15:07.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-code-plugins 2026-02-17T08:15:07.754 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:15:07.754 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:07.754 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:07.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.11805 2026-02-17T08:15:07.755 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:15:07.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:15:07.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:15:07.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-17T08:15:07.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:45: TEST_preload_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=jerasure_sse3 2026-02-17T08:15:07.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:07.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:15:07.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:15:07.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:15:07.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-17T08:15:07.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=jerasure_sse3 2026-02-17T08:15:07.777 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:15:07.777 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:15:07.777 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:15:07.777 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:15:07.777 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:07.777 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:07.777 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:15:07.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=jerasure_sse3 2026-02-17T08:15:07.805 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:15:07.806 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:15:07.806 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:15:07.807 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:15:07.807 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:15:07.808 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:15:07.808 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:15:07.808 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:15:07.808 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:15:07.808 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:15:07.808 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:07.809 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:07.809 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:15:07.809 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:15:07.809 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11805/ceph-mon.a.asok config get fsid 2026-02-17T08:15:07.864 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:15:07.864 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:15:07.864 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:15:07.864 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:15:07.864 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:15:07.864 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:15:07.864 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:15:07.864 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:15:07.865 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:15:07.865 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:07.865 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:07.865 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:15:07.865 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:15:07.865 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11805/ceph-mon.a.asok config get mon_host 2026-02-17T08:15:07.921 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:46: TEST_preload_warning: run_mgr td/test-erasure-code-plugins x 2026-02-17T08:15:07.922 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:07.922 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:15:07.922 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:15:07.922 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:15:07.922 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-17T08:15:07.922 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:15:08.030 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:15:08.030 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:15:08.030 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:15:08.031 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:15:08.031 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:08.031 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:08.031 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:15:08.032 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:15:08.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:15:08.049 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: get_asok_path mon.a 2026-02-17T08:15:08.049 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:15:08.049 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:15:08.049 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:15:08.050 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:08.050 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:08.050 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:15:08.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: CEPH_ARGS= 2026-02-17T08:15:08.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-mon.a.asok log flush 2026-02-17T08:15:08.098 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:15:08.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:48: TEST_preload_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=jerasure_sse3 2026-02-17T08:15:08.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:08.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:15:08.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:15:08.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:15:08.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-17T08:15:08.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-17T08:15:08.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:15:08.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:15:08.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:15:08.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-17T08:15:08.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-17T08:15:08.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:15:08.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:15:08.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-17T08:15:08.108 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:15:08.108 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:15:08.108 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:15:08.108 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:15:08.109 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:08.109 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:08.109 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:15:08.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:15:08.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:15:08.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:15:08.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:15:08.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-17T08:15:08.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-17T08:15:08.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:15:08.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:15:08.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:15:08.110 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:15:08.110 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:15:08.110 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_erasure_code_plugins=jerasure_sse3 2026-02-17T08:15:08.110 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-17T08:15:08.110 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:15:08.110 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=3d7867fc-0b3e-43d7-8ad2-38fa7fb1bd4b 2026-02-17T08:15:08.111 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 3d7867fc-0b3e-43d7-8ad2-38fa7fb1bd4b 2026-02-17T08:15:08.111 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 3d7867fc-0b3e-43d7-8ad2-38fa7fb1bd4b' 2026-02-17T08:15:08.111 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:15:08.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCMI5RpK3bLBhAAu7W2hYT8Ojd2TSKeeTmRjQ== 2026-02-17T08:15:08.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCMI5RpK3bLBhAAu7W2hYT8Ojd2TSKeeTmRjQ=="}' 2026-02-17T08:15:08.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 3d7867fc-0b3e-43d7-8ad2-38fa7fb1bd4b -i td/test-erasure-code-plugins/0/new.json 2026-02-17T08:15:08.227 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:15:08.235 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-17T08:15:08.236 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=jerasure_sse3 --mkfs --key AQCMI5RpK3bLBhAAu7W2hYT8Ojd2TSKeeTmRjQ== --osd-uuid 3d7867fc-0b3e-43d7-8ad2-38fa7fb1bd4b 2026-02-17T08:15:08.251 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:08.243+0000 7fe9725a48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:08.252 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:08.243+0000 7fe9725a48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:08.253 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:08.243+0000 7fe9725a48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:08.254 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:08.243+0000 7fe9725a48c0 -1 bdev(0x560b5b755c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:15:08.254 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:08.243+0000 7fe9725a48c0 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-17T08:15:10.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-17T08:15:10.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:15:10.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:15:10.822 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:15:10.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:15:11.092 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:15:11.093 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:15:11.093 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=jerasure_sse3 2026-02-17T08:15:11.093 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:15:11.093 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:15:11.093 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:15:11.114 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:11.103+0000 7f982b20a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:11.116 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:11.107+0000 7f982b20a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:11.117 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:11.107+0000 7f982b20a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:11.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:15:11.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:15:11.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:15:11.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:15:11.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:15:11.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:11.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:15:11.288 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:15:11.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:11.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:11.485 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:12.487 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:12.487 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:12.488 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:15:12.488 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:15:12.488 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:12.488 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:12.641 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:12.631+0000 7f982b20a8c0 -1 Falling back to public interface 2026-02-17T08:15:12.688 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:13.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:13.690 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:13.690 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:15:13.691 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:15:13.691 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:13.691 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:13.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:14.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:14.888 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:14.888 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:15:14.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:15:14.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:14.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:15.081 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:15.839 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:15.827+0000 7f982b20a8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:15:16.083 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:16.083 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:16.084 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:15:16.084 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:15:16.084 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:16.084 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:16.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:17.283 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:17.283 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:17.283 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:15:17.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:15:17.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:17.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:17.477 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2923966128,v1:127.0.0.1:6803/2923966128] [v2:127.0.0.1:6804/2923966128,v1:127.0.0.1:6805/2923966128] exists,up 3d7867fc-0b3e-43d7-8ad2-38fa7fb1bd4b 2026-02-17T08:15:17.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:15:17.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:15:17.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:15:17.479 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: get_asok_path osd.0 2026-02-17T08:15:17.479 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:15:17.480 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:15:17.480 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:15:17.480 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:17.480 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:17.480 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-osd.0.asok 2026-02-17T08:15:17.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: CEPH_ARGS= 2026-02-17T08:15:17.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-osd.0.asok log flush 2026-02-17T08:15:17.542 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:15:17.547 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:50: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin jerasure_sse3' td/test-erasure-code-plugins/mon.a.log 2026-02-17T08:15:17.549 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:15:07.783+0000 7fdec2a22ec0 0 WARNING: osd_erasure_code_plugins contains plugin jerasure_sse3 that is now deprecated. Please modify the value for osd_erasure_code_plugins to use jerasure instead. 2026-02-17T08:15:17.549 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:51: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin jerasure_sse3' td/test-erasure-code-plugins/osd.0.log 2026-02-17T08:15:17.550 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:15:12.631+0000 7f982b20a8c0 0 WARNING: osd_erasure_code_plugins contains plugin jerasure_sse3 that is now deprecated. Please modify the value for osd_erasure_code_plugins to use jerasure instead. 2026-02-17T08:15:17.551 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:52: TEST_preload_warning: teardown td/test-erasure-code-plugins 2026-02-17T08:15:17.551 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:17.551 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:15:17.551 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:15:17.551 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:15:17.551 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:15:17.551 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:15:17.551 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:15:17.552 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:15:17.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:15:17.659 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:15:17.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:15:17.660 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:15:17.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:15:17.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:15:17.662 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:15:17.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:17.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:15:17.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:15:17.664 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:17.665 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:15:17.666 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:15:17.666 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:15:17.671 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:15:17.671 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:17.671 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:17.671 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:15:17.673 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:15:17.673 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:15:17.673 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:43: TEST_preload_warning: for plugin in ${legacy_jerasure_plugins[*]} ${legacy_shec_plugins[*]} 2026-02-17T08:15:17.673 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:44: TEST_preload_warning: setup td/test-erasure-code-plugins 2026-02-17T08:15:17.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:17.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-code-plugins 2026-02-17T08:15:17.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:17.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:15:17.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:15:17.674 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:15:17.674 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:15:17.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:15:17.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:15:17.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:15:17.675 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:15:17.676 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:15:17.677 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:15:17.677 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:15:17.678 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:15:17.678 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:15:17.678 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:15:17.679 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:17.679 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:15:17.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:15:17.680 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:17.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:15:17.682 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:15:17.682 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:15:17.683 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:15:17.683 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:17.684 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:17.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:15:17.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:15:17.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:15:17.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-code-plugins 2026-02-17T08:15:17.686 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:15:17.686 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:17.686 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:17.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.11805 2026-02-17T08:15:17.688 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:15:17.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:15:17.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:15:17.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-17T08:15:17.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:45: TEST_preload_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=jerasure_sse4 2026-02-17T08:15:17.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:17.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:15:17.690 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:15:17.690 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:15:17.690 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-17T08:15:17.690 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=jerasure_sse4 2026-02-17T08:15:17.709 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:15:17.709 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:15:17.709 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:15:17.709 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:15:17.709 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:17.710 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:17.710 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:15:17.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=jerasure_sse4 2026-02-17T08:15:17.738 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:15:17.739 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:15:17.739 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:15:17.740 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:15:17.740 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:15:17.740 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:15:17.741 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:15:17.741 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:15:17.741 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:15:17.741 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:15:17.741 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:17.741 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:17.741 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:15:17.742 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:15:17.742 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11805/ceph-mon.a.asok config get fsid 2026-02-17T08:15:17.796 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:15:17.796 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:15:17.796 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:15:17.797 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:15:17.797 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:15:17.797 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:15:17.797 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:15:17.797 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:15:17.798 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:15:17.798 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:17.798 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:17.798 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:15:17.798 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:15:17.798 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11805/ceph-mon.a.asok config get mon_host 2026-02-17T08:15:17.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:46: TEST_preload_warning: run_mgr td/test-erasure-code-plugins x 2026-02-17T08:15:17.852 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:17.852 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:15:17.852 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:15:17.852 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:15:17.852 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-17T08:15:17.852 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:15:17.959 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:15:17.959 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:15:17.959 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:15:17.960 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:15:17.960 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:17.960 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:17.960 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:15:17.960 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:15:17.961 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:15:17.978 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: get_asok_path mon.a 2026-02-17T08:15:17.978 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:15:17.978 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:15:17.978 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:15:17.979 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:17.979 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:17.979 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:15:17.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: CEPH_ARGS= 2026-02-17T08:15:17.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-mon.a.asok log flush 2026-02-17T08:15:18.027 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:15:18.037 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:48: TEST_preload_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=jerasure_sse4 2026-02-17T08:15:18.037 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:18.037 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:15:18.037 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:15:18.037 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:15:18.037 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-17T08:15:18.037 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-17T08:15:18.037 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:15:18.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:15:18.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:15:18.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-17T08:15:18.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-17T08:15:18.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:15:18.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:15:18.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-17T08:15:18.038 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:15:18.038 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:15:18.038 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:15:18.038 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:15:18.038 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:18.039 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:18.039 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:15:18.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:15:18.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:15:18.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:15:18.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:15:18.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-17T08:15:18.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-17T08:15:18.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:15:18.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:15:18.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:15:18.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:15:18.040 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:15:18.040 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_erasure_code_plugins=jerasure_sse4 2026-02-17T08:15:18.040 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-17T08:15:18.040 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:15:18.040 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=2258ee3e-6a33-4792-9964-b73ea6e3cee1 2026-02-17T08:15:18.041 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 2258ee3e-6a33-4792-9964-b73ea6e3cee1 2026-02-17T08:15:18.041 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 2258ee3e-6a33-4792-9964-b73ea6e3cee1' 2026-02-17T08:15:18.041 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:15:18.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCWI5RppnF8AhAAHdzKGVSV7UhmZZGrsKL2iw== 2026-02-17T08:15:18.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCWI5RppnF8AhAAHdzKGVSV7UhmZZGrsKL2iw=="}' 2026-02-17T08:15:18.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 2258ee3e-6a33-4792-9964-b73ea6e3cee1 -i td/test-erasure-code-plugins/0/new.json 2026-02-17T08:15:18.157 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:15:18.165 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-17T08:15:18.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=jerasure_sse4 --mkfs --key AQCWI5RppnF8AhAAHdzKGVSV7UhmZZGrsKL2iw== --osd-uuid 2258ee3e-6a33-4792-9964-b73ea6e3cee1 2026-02-17T08:15:18.181 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:18.171+0000 7f9c73cb48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:18.182 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:18.171+0000 7f9c73cb48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:18.183 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:18.171+0000 7f9c73cb48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:18.183 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:18.175+0000 7f9c73cb48c0 -1 bdev(0x55ebfd1d1c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:15:18.184 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:18.175+0000 7f9c73cb48c0 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-17T08:15:20.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-17T08:15:20.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:15:20.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:15:20.977 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:15:20.978 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:15:21.242 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:15:21.243 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:15:21.243 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=jerasure_sse4 2026-02-17T08:15:21.244 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:15:21.244 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:15:21.244 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:15:21.265 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:21.254+0000 7fbc0499f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:21.267 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:21.254+0000 7fbc0499f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:21.268 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:21.258+0000 7fbc0499f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:21.440 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:15:21.440 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:15:21.440 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:15:21.440 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:15:21.440 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:15:21.440 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:21.441 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:15:21.441 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:15:21.441 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:21.442 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:21.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:22.635 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:22.635 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:22.635 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:15:22.636 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:15:22.636 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:22.636 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:22.801 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:22.790+0000 7fbc0499f8c0 -1 Falling back to public interface 2026-02-17T08:15:22.831 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:23.832 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:23.832 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:23.833 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:15:23.833 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:15:23.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:23.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:24.025 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:25.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:25.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:25.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:15:25.027 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:15:25.028 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:25.028 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:25.221 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:25.831 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:25.818+0000 7fbc0499f8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:15:26.222 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:26.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:26.223 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:15:26.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:15:26.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:26.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:26.422 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:27.423 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:27.424 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:27.424 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:15:27.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:15:27.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:27.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:27.622 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1013811384,v1:127.0.0.1:6803/1013811384] [v2:127.0.0.1:6804/1013811384,v1:127.0.0.1:6805/1013811384] exists,up 2258ee3e-6a33-4792-9964-b73ea6e3cee1 2026-02-17T08:15:27.623 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:15:27.623 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:15:27.623 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:15:27.624 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: get_asok_path osd.0 2026-02-17T08:15:27.624 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:15:27.624 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:15:27.624 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:15:27.624 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:27.624 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:27.624 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-osd.0.asok 2026-02-17T08:15:27.624 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: CEPH_ARGS= 2026-02-17T08:15:27.624 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-osd.0.asok log flush 2026-02-17T08:15:27.686 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:15:27.691 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:50: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin jerasure_sse4' td/test-erasure-code-plugins/mon.a.log 2026-02-17T08:15:27.692 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:15:17.715+0000 7f6cb518aec0 0 WARNING: osd_erasure_code_plugins contains plugin jerasure_sse4 that is now deprecated. Please modify the value for osd_erasure_code_plugins to use jerasure instead. 2026-02-17T08:15:27.693 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:51: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin jerasure_sse4' td/test-erasure-code-plugins/osd.0.log 2026-02-17T08:15:27.694 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:15:22.790+0000 7fbc0499f8c0 0 WARNING: osd_erasure_code_plugins contains plugin jerasure_sse4 that is now deprecated. Please modify the value for osd_erasure_code_plugins to use jerasure instead. 2026-02-17T08:15:27.695 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:52: TEST_preload_warning: teardown td/test-erasure-code-plugins 2026-02-17T08:15:27.695 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:27.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:15:27.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:15:27.696 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:15:27.696 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:15:27.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:15:27.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:15:27.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:15:27.804 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:15:27.804 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:15:27.805 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:15:27.805 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:15:27.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:15:27.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:15:27.807 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:15:27.808 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:27.808 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:15:27.809 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:15:27.809 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:27.810 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:15:27.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:15:27.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:15:27.815 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:15:27.815 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:27.816 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:27.816 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:15:27.818 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:15:27.818 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:15:27.818 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:43: TEST_preload_warning: for plugin in ${legacy_jerasure_plugins[*]} ${legacy_shec_plugins[*]} 2026-02-17T08:15:27.818 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:44: TEST_preload_warning: setup td/test-erasure-code-plugins 2026-02-17T08:15:27.818 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:27.818 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-code-plugins 2026-02-17T08:15:27.818 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:27.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:15:27.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:15:27.819 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:15:27.819 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:15:27.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:15:27.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:15:27.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:15:27.820 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:15:27.820 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:15:27.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:15:27.821 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:15:27.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:15:27.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:15:27.822 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:15:27.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:27.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:15:27.824 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:15:27.824 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:27.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:15:27.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:15:27.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:15:27.828 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:15:27.828 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:27.828 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:27.828 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:15:27.829 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:15:27.829 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:15:27.829 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-code-plugins 2026-02-17T08:15:27.830 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:15:27.830 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:27.831 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:27.831 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.11805 2026-02-17T08:15:27.832 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:15:27.833 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:15:27.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:15:27.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-17T08:15:27.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:45: TEST_preload_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=shec_generic 2026-02-17T08:15:27.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:27.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:15:27.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:15:27.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:15:27.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-17T08:15:27.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=shec_generic 2026-02-17T08:15:27.854 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:15:27.854 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:15:27.854 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:15:27.855 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:15:27.855 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:27.855 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:27.855 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:15:27.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=shec_generic 2026-02-17T08:15:27.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:15:27.882 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:15:27.882 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:15:27.882 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:15:27.883 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:15:27.883 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:15:27.883 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:15:27.883 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:15:27.883 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:15:27.884 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:15:27.884 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:27.884 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:27.884 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:15:27.884 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:15:27.884 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11805/ceph-mon.a.asok config get fsid 2026-02-17T08:15:27.945 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:15:27.946 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:15:27.946 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:15:27.946 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:15:27.946 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:15:27.946 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:15:27.946 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:15:27.946 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:15:27.946 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:15:27.946 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:27.946 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:27.946 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:15:27.947 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:15:27.947 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11805/ceph-mon.a.asok config get mon_host 2026-02-17T08:15:27.999 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:46: TEST_preload_warning: run_mgr td/test-erasure-code-plugins x 2026-02-17T08:15:27.999 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:28.000 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:15:28.000 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:15:28.000 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:15:28.000 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-17T08:15:28.000 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:15:28.105 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:15:28.106 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:15:28.106 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:15:28.106 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:15:28.106 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:28.106 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:28.106 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:15:28.107 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:15:28.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:15:28.124 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: get_asok_path mon.a 2026-02-17T08:15:28.124 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:15:28.124 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:15:28.124 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:15:28.124 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:28.124 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:28.124 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:15:28.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: CEPH_ARGS= 2026-02-17T08:15:28.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-mon.a.asok log flush 2026-02-17T08:15:28.174 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:15:28.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:48: TEST_preload_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=shec_generic 2026-02-17T08:15:28.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:28.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:15:28.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:15:28.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:15:28.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-17T08:15:28.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-17T08:15:28.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:15:28.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:15:28.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:15:28.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-17T08:15:28.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-17T08:15:28.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:15:28.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:15:28.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-17T08:15:28.185 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:15:28.185 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:15:28.185 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:15:28.185 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:15:28.185 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:28.185 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:28.185 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:15:28.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:15:28.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:15:28.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:15:28.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:15:28.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-17T08:15:28.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-17T08:15:28.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:15:28.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:15:28.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:15:28.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:15:28.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:15:28.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_erasure_code_plugins=shec_generic 2026-02-17T08:15:28.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-17T08:15:28.187 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:15:28.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=8ce493f6-50bd-4de4-8bed-3cb7228a869d 2026-02-17T08:15:28.187 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 8ce493f6-50bd-4de4-8bed-3cb7228a869d 2026-02-17T08:15:28.188 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 8ce493f6-50bd-4de4-8bed-3cb7228a869d' 2026-02-17T08:15:28.188 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:15:28.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCgI5Rp1yNECxAAnTVSklPyA0scRgY4YrAKaQ== 2026-02-17T08:15:28.196 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCgI5Rp1yNECxAAnTVSklPyA0scRgY4YrAKaQ=="}' 2026-02-17T08:15:28.196 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 8ce493f6-50bd-4de4-8bed-3cb7228a869d -i td/test-erasure-code-plugins/0/new.json 2026-02-17T08:15:28.305 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:15:28.313 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-17T08:15:28.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=shec_generic --mkfs --key AQCgI5Rp1yNECxAAnTVSklPyA0scRgY4YrAKaQ== --osd-uuid 8ce493f6-50bd-4de4-8bed-3cb7228a869d 2026-02-17T08:15:28.329 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:28.318+0000 7f635b9ba8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:28.330 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:28.318+0000 7f635b9ba8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:28.331 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:28.318+0000 7f635b9ba8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:28.332 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:28.318+0000 7f635b9ba8c0 -1 bdev(0x55e832c87c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:15:28.332 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:28.322+0000 7f635b9ba8c0 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-17T08:15:31.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-17T08:15:31.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:15:31.134 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:15:31.134 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:15:31.134 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:15:31.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:15:31.400 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:15:31.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=shec_generic 2026-02-17T08:15:31.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:15:31.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:15:31.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:15:31.423 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:31.410+0000 7f5b971538c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:31.424 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:31.414+0000 7f5b971538c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:31.425 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:31.414+0000 7f5b971538c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:31.597 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:15:31.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:15:31.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:15:31.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:15:31.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:15:31.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:31.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:15:31.598 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:15:31.599 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:31.599 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:31.800 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:32.801 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:32.801 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:32.802 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:15:32.802 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:15:32.802 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:32.803 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:32.949 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:32.938+0000 7f5b971538c0 -1 Falling back to public interface 2026-02-17T08:15:32.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:33.996 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:33.996 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:33.997 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:15:33.997 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:15:33.997 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:33.998 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:34.197 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:35.198 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:35.198 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:35.198 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:15:35.198 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:15:35.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:35.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:35.392 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:35.935 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:35.922+0000 7f5b971538c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:15:36.393 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:36.394 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:36.394 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:15:36.394 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:15:36.395 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:36.395 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:36.592 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2496597412,v1:127.0.0.1:6803/2496597412] [v2:127.0.0.1:6804/2496597412,v1:127.0.0.1:6805/2496597412] exists,up 8ce493f6-50bd-4de4-8bed-3cb7228a869d 2026-02-17T08:15:36.593 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:15:36.594 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:15:36.594 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:15:36.594 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: get_asok_path osd.0 2026-02-17T08:15:36.594 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:15:36.594 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:15:36.594 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:15:36.594 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:36.594 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:36.594 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-osd.0.asok 2026-02-17T08:15:36.595 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: CEPH_ARGS= 2026-02-17T08:15:36.595 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-osd.0.asok log flush 2026-02-17T08:15:36.648 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:15:36.654 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:50: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin shec_generic' td/test-erasure-code-plugins/mon.a.log 2026-02-17T08:15:36.655 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:15:27.858+0000 7ff93dc18ec0 0 WARNING: osd_erasure_code_plugins contains plugin shec_generic that is now deprecated. Please modify the value for osd_erasure_code_plugins to use shec instead. 2026-02-17T08:15:36.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:51: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin shec_generic' td/test-erasure-code-plugins/osd.0.log 2026-02-17T08:15:36.656 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:15:32.938+0000 7f5b971538c0 0 WARNING: osd_erasure_code_plugins contains plugin shec_generic that is now deprecated. Please modify the value for osd_erasure_code_plugins to use shec instead. 2026-02-17T08:15:36.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:52: TEST_preload_warning: teardown td/test-erasure-code-plugins 2026-02-17T08:15:36.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:36.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:15:36.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:15:36.658 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:15:36.658 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:15:36.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:15:36.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:15:36.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:15:36.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:15:36.766 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:15:36.767 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:15:36.768 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:15:36.769 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:15:36.769 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:15:36.769 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:15:36.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:36.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:15:36.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:15:36.771 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:36.771 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:15:36.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:15:36.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:15:36.776 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:15:36.776 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:36.776 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:36.776 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:15:36.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:15:36.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:15:36.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:43: TEST_preload_warning: for plugin in ${legacy_jerasure_plugins[*]} ${legacy_shec_plugins[*]} 2026-02-17T08:15:36.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:44: TEST_preload_warning: setup td/test-erasure-code-plugins 2026-02-17T08:15:36.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:36.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-code-plugins 2026-02-17T08:15:36.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:36.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:15:36.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:15:36.779 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:15:36.779 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:15:36.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:15:36.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:15:36.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:15:36.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:15:36.781 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:15:36.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:15:36.782 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:15:36.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:15:36.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:15:36.783 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:15:36.784 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:36.784 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:15:36.784 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:15:36.784 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:36.785 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:15:36.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:15:36.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:15:36.788 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:15:36.788 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:36.788 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:36.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:15:36.790 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:15:36.790 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:15:36.790 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-code-plugins 2026-02-17T08:15:36.791 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:15:36.791 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:36.791 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:36.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.11805 2026-02-17T08:15:36.793 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:15:36.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:15:36.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:15:36.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-17T08:15:36.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:45: TEST_preload_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=shec_sse3 2026-02-17T08:15:36.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:36.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:15:36.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:15:36.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:15:36.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-17T08:15:36.795 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=shec_sse3 2026-02-17T08:15:36.813 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:15:36.813 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:15:36.814 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:15:36.814 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:15:36.815 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:36.815 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:36.815 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:15:36.815 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=shec_sse3 2026-02-17T08:15:36.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:15:36.843 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:15:36.843 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:15:36.843 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:15:36.843 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:15:36.843 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:15:36.844 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:15:36.844 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:15:36.845 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:15:36.845 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:15:36.845 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:36.845 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:36.845 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:15:36.845 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:15:36.845 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11805/ceph-mon.a.asok config get fsid 2026-02-17T08:15:36.898 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:15:36.899 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:15:36.899 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:15:36.899 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:15:36.899 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:15:36.900 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:15:36.900 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:15:36.900 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:15:36.900 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:15:36.901 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:36.901 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:36.901 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:15:36.901 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:15:36.901 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11805/ceph-mon.a.asok config get mon_host 2026-02-17T08:15:36.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:46: TEST_preload_warning: run_mgr td/test-erasure-code-plugins x 2026-02-17T08:15:36.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:36.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:15:36.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:15:36.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:15:36.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-17T08:15:36.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:15:37.061 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:15:37.061 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:15:37.061 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:15:37.061 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:15:37.061 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:37.061 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:37.062 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:15:37.062 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:15:37.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:15:37.081 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: get_asok_path mon.a 2026-02-17T08:15:37.081 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:15:37.081 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:15:37.081 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:15:37.081 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:37.081 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:37.081 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:15:37.082 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: CEPH_ARGS= 2026-02-17T08:15:37.082 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-mon.a.asok log flush 2026-02-17T08:15:37.131 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:15:37.139 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:48: TEST_preload_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=shec_sse3 2026-02-17T08:15:37.139 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:37.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:15:37.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:15:37.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:15:37.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-17T08:15:37.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-17T08:15:37.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:15:37.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:15:37.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:15:37.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-17T08:15:37.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-17T08:15:37.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:15:37.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:15:37.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-17T08:15:37.141 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:15:37.141 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:15:37.141 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:15:37.141 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:15:37.141 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:37.141 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:37.141 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:15:37.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:15:37.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:15:37.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:15:37.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:15:37.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-17T08:15:37.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-17T08:15:37.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:15:37.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:15:37.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:15:37.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:15:37.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:15:37.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_erasure_code_plugins=shec_sse3 2026-02-17T08:15:37.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-17T08:15:37.143 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:15:37.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=c41a2b74-fb8b-4c7b-b7a7-acabe5cc02de 2026-02-17T08:15:37.143 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 c41a2b74-fb8b-4c7b-b7a7-acabe5cc02de 2026-02-17T08:15:37.144 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 c41a2b74-fb8b-4c7b-b7a7-acabe5cc02de' 2026-02-17T08:15:37.144 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:15:37.151 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCpI5RpnniUCBAAfh01KgtuOQKZJa02kU1mZg== 2026-02-17T08:15:37.151 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCpI5RpnniUCBAAfh01KgtuOQKZJa02kU1mZg=="}' 2026-02-17T08:15:37.151 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new c41a2b74-fb8b-4c7b-b7a7-acabe5cc02de -i td/test-erasure-code-plugins/0/new.json 2026-02-17T08:15:37.261 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:15:37.269 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-17T08:15:37.270 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=shec_sse3 --mkfs --key AQCpI5RpnniUCBAAfh01KgtuOQKZJa02kU1mZg== --osd-uuid c41a2b74-fb8b-4c7b-b7a7-acabe5cc02de 2026-02-17T08:15:37.285 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:37.274+0000 7f190f4a38c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:37.287 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:37.274+0000 7f190f4a38c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:37.288 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:37.274+0000 7f190f4a38c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:37.288 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:37.274+0000 7f190f4a38c0 -1 bdev(0x560a49413c00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:15:37.288 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:37.278+0000 7f190f4a38c0 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-17T08:15:39.876 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-17T08:15:39.876 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:15:39.877 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:15:39.877 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:15:39.877 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:15:40.136 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:15:40.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:15:40.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=shec_sse3 2026-02-17T08:15:40.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:15:40.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:15:40.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:15:40.159 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:40.146+0000 7fe53dec28c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:40.161 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:40.150+0000 7fe53dec28c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:40.162 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:40.150+0000 7fe53dec28c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:40.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:15:40.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:15:40.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:15:40.335 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:15:40.335 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:15:40.335 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:40.335 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:15:40.336 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:15:40.336 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:40.336 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:40.537 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:41.539 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:41.539 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:41.540 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:15:41.540 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:15:41.540 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:41.541 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:41.733 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:41.865 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:41.854+0000 7fe53dec28c0 -1 Falling back to public interface 2026-02-17T08:15:42.734 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:42.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:42.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:15:42.735 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:15:42.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:42.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:42.932 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:43.934 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:43.934 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:43.934 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:15:43.935 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:15:43.935 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:43.935 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:44.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:44.891 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:44.878+0000 7fe53dec28c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:15:45.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:45.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:45.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:15:45.126 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:15:45.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:45.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:45.317 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:46.319 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:46.319 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:46.319 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:15:46.320 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:15:46.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:46.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:46.513 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/594264097,v1:127.0.0.1:6803/594264097] [v2:127.0.0.1:6804/594264097,v1:127.0.0.1:6805/594264097] exists,up c41a2b74-fb8b-4c7b-b7a7-acabe5cc02de 2026-02-17T08:15:46.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:15:46.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:15:46.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:15:46.515 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: get_asok_path osd.0 2026-02-17T08:15:46.515 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:15:46.515 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:15:46.515 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:15:46.515 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:46.516 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:46.516 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-osd.0.asok 2026-02-17T08:15:46.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: CEPH_ARGS= 2026-02-17T08:15:46.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-osd.0.asok log flush 2026-02-17T08:15:46.578 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:15:46.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:50: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin shec_sse3' td/test-erasure-code-plugins/mon.a.log 2026-02-17T08:15:46.584 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:15:36.818+0000 7f0e0fc46ec0 0 WARNING: osd_erasure_code_plugins contains plugin shec_sse3 that is now deprecated. Please modify the value for osd_erasure_code_plugins to use shec instead. 2026-02-17T08:15:46.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:51: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin shec_sse3' td/test-erasure-code-plugins/osd.0.log 2026-02-17T08:15:46.586 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:15:41.854+0000 7fe53dec28c0 0 WARNING: osd_erasure_code_plugins contains plugin shec_sse3 that is now deprecated. Please modify the value for osd_erasure_code_plugins to use shec instead. 2026-02-17T08:15:46.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:52: TEST_preload_warning: teardown td/test-erasure-code-plugins 2026-02-17T08:15:46.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:46.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:15:46.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:15:46.587 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:15:46.587 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:15:46.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:15:46.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:15:46.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:15:46.695 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:15:46.696 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:15:46.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:15:46.697 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:15:46.698 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:15:46.698 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:15:46.698 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:15:46.699 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:46.699 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:15:46.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:15:46.700 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:46.701 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:15:46.702 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:15:46.702 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:15:46.707 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:15:46.707 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:46.707 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:46.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:15:46.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:15:46.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:15:46.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:43: TEST_preload_warning: for plugin in ${legacy_jerasure_plugins[*]} ${legacy_shec_plugins[*]} 2026-02-17T08:15:46.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:44: TEST_preload_warning: setup td/test-erasure-code-plugins 2026-02-17T08:15:46.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:46.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-code-plugins 2026-02-17T08:15:46.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:46.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:15:46.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:15:46.710 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:15:46.711 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:15:46.711 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:15:46.711 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:15:46.711 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:15:46.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:15:46.712 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:15:46.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:15:46.714 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:15:46.714 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:15:46.714 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:15:46.715 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:15:46.716 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:46.716 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:15:46.716 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:15:46.717 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:46.717 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:15:46.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:15:46.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:15:46.720 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:15:46.720 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:46.720 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:46.720 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:15:46.721 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:15:46.721 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:15:46.721 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-code-plugins 2026-02-17T08:15:46.723 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:15:46.723 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:46.723 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:46.723 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.11805 2026-02-17T08:15:46.724 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:15:46.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:15:46.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:15:46.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-code-plugins 1' TERM HUP INT 2026-02-17T08:15:46.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:45: TEST_preload_warning: run_mon td/test-erasure-code-plugins a --osd_erasure_code_plugins=shec_sse4 2026-02-17T08:15:46.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:46.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:15:46.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:15:46.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:15:46.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-code-plugins/a 2026-02-17T08:15:46.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins --osd_erasure_code_plugins=shec_sse4 2026-02-17T08:15:46.746 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:15:46.746 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:15:46.747 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:15:46.747 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:15:46.747 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:46.747 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:46.747 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:15:46.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code-plugins/a '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code-plugins/log --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_erasure_code_plugins=shec_sse4 2026-02-17T08:15:46.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:15:46.775 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:15:46.775 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:15:46.775 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:15:46.775 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:15:46.777 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:15:46.777 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:15:46.777 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:15:46.777 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:15:46.777 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:15:46.777 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:46.777 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:46.777 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:15:46.777 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:15:46.777 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11805/ceph-mon.a.asok config get fsid 2026-02-17T08:15:46.831 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:15:46.831 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:15:46.832 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:15:46.832 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:15:46.833 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:15:46.833 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:15:46.833 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:15:46.833 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:15:46.833 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:15:46.833 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:46.833 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:46.834 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:15:46.834 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:15:46.834 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11805/ceph-mon.a.asok config get mon_host 2026-02-17T08:15:46.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:46: TEST_preload_warning: run_mgr td/test-erasure-code-plugins x 2026-02-17T08:15:46.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:46.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:15:46.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:15:46.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:15:46.888 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-code-plugins/x 2026-02-17T08:15:46.888 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:15:46.994 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:15:46.994 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:15:46.994 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:15:46.994 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:15:46.994 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:46.994 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:46.994 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:15:46.995 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:15:46.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code-plugins/x '--log-file=td/test-erasure-code-plugins/$name.log' '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --run-dir=td/test-erasure-code-plugins '--pid-file=td/test-erasure-code-plugins/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:15:47.013 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: get_asok_path mon.a 2026-02-17T08:15:47.013 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:15:47.013 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:15:47.014 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:15:47.014 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:47.014 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:47.014 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-mon.a.asok 2026-02-17T08:15:47.014 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: CEPH_ARGS= 2026-02-17T08:15:47.014 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:47: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-mon.a.asok log flush 2026-02-17T08:15:47.062 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:15:47.070 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:48: TEST_preload_warning: run_osd td/test-erasure-code-plugins 0 --osd_erasure_code_plugins=shec_sse4 2026-02-17T08:15:47.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:47.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:15:47.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:15:47.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:15:47.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code-plugins/0 2026-02-17T08:15:47.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 ' 2026-02-17T08:15:47.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:15:47.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:15:47.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:15:47.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code-plugins/0' 2026-02-17T08:15:47.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code-plugins/0/journal' 2026-02-17T08:15:47.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:15:47.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:15:47.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code-plugins' 2026-02-17T08:15:47.072 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:15:47.072 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:15:47.072 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:15:47.072 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:15:47.072 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:47.072 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:47.073 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:15:47.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' 2026-02-17T08:15:47.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:15:47.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:15:47.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:15:47.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code-plugins/$name.log' 2026-02-17T08:15:47.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code-plugins/$name.pid' 2026-02-17T08:15:47.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:15:47.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:15:47.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:15:47.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:15:47.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:15:47.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+=--osd_erasure_code_plugins=shec_sse4 2026-02-17T08:15:47.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code-plugins/0 2026-02-17T08:15:47.074 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:15:47.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=ddb9fd85-2361-449c-8d19-61f380da9213 2026-02-17T08:15:47.075 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 ddb9fd85-2361-449c-8d19-61f380da9213 2026-02-17T08:15:47.075 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 ddb9fd85-2361-449c-8d19-61f380da9213' 2026-02-17T08:15:47.075 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:15:47.084 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCzI5RpquCaBBAAptRu7MWPjpLsdp8sdRLPFA== 2026-02-17T08:15:47.084 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCzI5RpquCaBBAAptRu7MWPjpLsdp8sdRLPFA=="}' 2026-02-17T08:15:47.084 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new ddb9fd85-2361-449c-8d19-61f380da9213 -i td/test-erasure-code-plugins/0/new.json 2026-02-17T08:15:47.192 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:15:47.200 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code-plugins/0/new.json 2026-02-17T08:15:47.201 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=shec_sse4 --mkfs --key AQCzI5RpquCaBBAAptRu7MWPjpLsdp8sdRLPFA== --osd-uuid ddb9fd85-2361-449c-8d19-61f380da9213 2026-02-17T08:15:47.217 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:47.210+0000 7f90fa0958c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:47.218 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:47.210+0000 7f90fa0958c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:47.219 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:47.210+0000 7f90fa0958c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:47.219 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:47.210+0000 7f90fa0958c0 -1 bdev(0x559b4888dc00 td/test-erasure-code-plugins/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:15:47.219 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:47.210+0000 7f90fa0958c0 -1 bluestore(td/test-erasure-code-plugins/0) _read_fsid unparsable uuid 2026-02-17T08:15:49.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code-plugins/0/keyring 2026-02-17T08:15:49.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:15:49.754 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:15:49.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:15:49.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code-plugins/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:15:50.026 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:15:50.026 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:15:50.026 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=0f7d9d7f-9eac-46cc-98ff-3c8329baedc2 --auth-supported=none --mon-host=127.0.0.1:17110 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code-plugins/0 --osd-journal=td/test-erasure-code-plugins/0/journal --chdir= --run-dir=td/test-erasure-code-plugins '--admin-socket=/tmp/ceph-asok.11805/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code-plugins/$name.log' '--pid-file=td/test-erasure-code-plugins/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_erasure_code_plugins=shec_sse4 2026-02-17T08:15:50.026 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:15:50.026 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:15:50.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:15:50.049 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:50.042+0000 7f79259e48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:50.050 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:50.042+0000 7f79259e48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:50.052 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:50.042+0000 7f79259e48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:50.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:15:50.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:15:50.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:15:50.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:15:50.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:15:50.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:50.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:15:50.219 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:15:50.219 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:50.219 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:50.416 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:51.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:51.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:51.418 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:15:51.418 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:15:51.418 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:51.419 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:51.582 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:51.574+0000 7f79259e48c0 -1 Falling back to public interface 2026-02-17T08:15:51.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:52.617 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:52.617 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:52.617 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:15:52.618 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:15:52.618 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:52.618 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:52.812 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:53.813 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:53.813 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:53.813 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:15:53.813 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:15:53.813 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:53.813 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:54.012 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:15:54.590 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:54.581+0000 7f79259e48c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:15:55.014 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:15:55.014 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:55.015 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:15:55.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:15:55.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:55.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:55.216 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1070220769,v1:127.0.0.1:6803/1070220769] [v2:127.0.0.1:6804/1070220769,v1:127.0.0.1:6805/1070220769] exists,up ddb9fd85-2361-449c-8d19-61f380da9213 2026-02-17T08:15:55.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:15:55.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:15:55.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:15:55.218 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: get_asok_path osd.0 2026-02-17T08:15:55.218 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:15:55.218 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:15:55.218 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:15:55.218 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:55.219 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:55.219 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11805/ceph-osd.0.asok 2026-02-17T08:15:55.219 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: CEPH_ARGS= 2026-02-17T08:15:55.219 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:49: TEST_preload_warning: ceph --admin-daemon /tmp/ceph-asok.11805/ceph-osd.0.asok log flush 2026-02-17T08:15:55.270 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:15:55.276 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:50: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin shec_sse4' td/test-erasure-code-plugins/mon.a.log 2026-02-17T08:15:55.277 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:15:46.754+0000 7fdaaff34ec0 0 WARNING: osd_erasure_code_plugins contains plugin shec_sse4 that is now deprecated. Please modify the value for osd_erasure_code_plugins to use shec instead. 2026-02-17T08:15:55.277 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:51: TEST_preload_warning: grep 'WARNING: osd_erasure_code_plugins contains plugin shec_sse4' td/test-erasure-code-plugins/osd.0.log 2026-02-17T08:15:55.278 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:15:51.574+0000 7f79259e48c0 0 WARNING: osd_erasure_code_plugins contains plugin shec_sse4 that is now deprecated. Please modify the value for osd_erasure_code_plugins to use shec instead. 2026-02-17T08:15:55.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:52: TEST_preload_warning: teardown td/test-erasure-code-plugins 2026-02-17T08:15:55.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:55.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:15:55.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:15:55.280 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:15:55.280 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:15:55.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:15:55.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:15:55.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:15:55.387 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:15:55.388 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:15:55.389 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:15:55.389 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:15:55.390 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:15:55.391 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:15:55.391 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:15:55.392 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:55.392 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:15:55.393 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:15:55.393 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:55.394 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:15:55.395 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:15:55.395 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:15:55.399 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:15:55.399 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:55.400 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:55.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:15:55.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:15:55.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:15:55.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh:54: TEST_preload_warning: return 0 2026-02-17T08:15:55.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: main: code=0 2026-02-17T08:15:55.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: main: teardown td/test-erasure-code-plugins 0 2026-02-17T08:15:55.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code-plugins 2026-02-17T08:15:55.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2026-02-17T08:15:55.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code-plugins KILL 2026-02-17T08:15:55.402 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:15:55.403 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:15:55.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:15:55.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:15:55.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:15:55.404 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:15:55.404 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:15:55.405 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:15:55.405 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:15:55.406 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:15:55.406 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:15:55.407 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:15:55.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:55.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:15:55.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:15:55.409 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:55.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:15:55.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T08:15:55.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code-plugins 2026-02-17T08:15:55.412 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:15:55.412 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:55.412 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11805 2026-02-17T08:15:55.412 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11805 2026-02-17T08:15:55.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:15:55.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:15:55.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: main: return 0 2026-02-17T08:15:55.414 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T08:15:55.414 DEBUG:teuthology.orchestra.run.trial059:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T08:15:55.423 INFO:tasks.workunit:Running workunit erasure-code/test-erasure-code.sh... 2026-02-17T08:15:55.423 DEBUG:teuthology.orchestra.run.trial059:workunit test erasure-code/test-erasure-code.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh 2026-02-17T08:15:55.473 INFO:tasks.workunit.client.0.trial059.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T08:15:55.476 INFO:tasks.workunit.client.0.trial059.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T08:15:55.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T08:15:55.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T08:15:55.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: export PYTHONWARNINGS=ignore 2026-02-17T08:15:55.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: PYTHONWARNINGS=ignore 2026-02-17T08:15:55.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: export CEPH_CONF=/dev/null 2026-02-17T08:15:55.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: CEPH_CONF=/dev/null 2026-02-17T08:15:55.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: main: unset CEPH_ARGS 2026-02-17T08:15:55.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2375: main: local code 2026-02-17T08:15:55.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: main: run td/test-erasure-code 2026-02-17T08:15:55.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:22: run: local dir=td/test-erasure-code 2026-02-17T08:15:55.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:23: run: shift 2026-02-17T08:15:55.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:25: run: export CEPH_MON=127.0.0.1:7101 2026-02-17T08:15:55.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:25: run: CEPH_MON=127.0.0.1:7101 2026-02-17T08:15:55.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:26: run: export CEPH_ARGS 2026-02-17T08:15:55.478 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:27: run: uuidgen 2026-02-17T08:15:55.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:27: run: CEPH_ARGS+='--fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none ' 2026-02-17T08:15:55.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-17T08:15:55.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:30: run: setup td/test-erasure-code 2026-02-17T08:15:55.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-code 2026-02-17T08:15:55.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-code 2026-02-17T08:15:55.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code 2026-02-17T08:15:55.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:15:55.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code KILL 2026-02-17T08:15:55.480 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:15:55.480 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:15:55.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:15:55.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:15:55.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:15:55.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:15:55.481 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:15:55.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:15:55.482 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:15:55.483 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:15:55.483 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:15:55.483 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:15:55.484 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:55.484 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:15:55.484 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:15:55.484 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:15:55.485 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:15:55.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:15:55.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code 2026-02-17T08:15:55.488 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:15:55.488 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:55.488 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:15:55.488 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.41658 2026-02-17T08:15:55.489 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:15:55.489 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:15:55.489 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-code 2026-02-17T08:15:55.490 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:15:55.490 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:55.491 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:15:55.491 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.41658 2026-02-17T08:15:55.491 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:15:55.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2026-02-17T08:15:55.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2026-02-17T08:15:55.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:15:55.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-code 1' TERM HUP INT 2026-02-17T08:15:55.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:31: run: run_mon td/test-erasure-code a 2026-02-17T08:15:55.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-code 2026-02-17T08:15:55.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:15:55.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:15:55.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:15:55.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-code/a 2026-02-17T08:15:55.494 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-code/a --run-dir=td/test-erasure-code 2026-02-17T08:15:55.520 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:15:55.520 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:15:55.520 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:15:55.520 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:15:55.520 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:55.520 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:15:55.521 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:15:55.521 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-code/a '--log-file=td/test-erasure-code/$name.log' '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-code/log --run-dir=td/test-erasure-code '--pid-file=td/test-erasure-code/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T08:15:55.546 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:15:55.547 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:15:55.547 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:15:55.547 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:15:55.547 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:15:55.548 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:15:55.548 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:15:55.549 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:15:55.549 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:15:55.549 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:15:55.549 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:55.549 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:15:55.549 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.41658/ceph-mon.a.asok 2026-02-17T08:15:55.549 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:15:55.549 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.41658/ceph-mon.a.asok config get fsid 2026-02-17T08:15:55.603 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:15:55.603 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:15:55.603 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:15:55.604 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:15:55.605 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:15:55.605 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:15:55.605 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:15:55.605 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:15:55.605 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:15:55.605 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:55.605 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:15:55.605 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.41658/ceph-mon.a.asok 2026-02-17T08:15:55.605 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:15:55.605 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.41658/ceph-mon.a.asok config get mon_host 2026-02-17T08:15:55.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:32: run: run_mgr td/test-erasure-code x 2026-02-17T08:15:55.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-code 2026-02-17T08:15:55.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:15:55.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:15:55.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:15:55.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-code/x 2026-02-17T08:15:55.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:15:55.768 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:15:55.768 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:15:55.768 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:15:55.768 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:15:55.768 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:55.768 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:15:55.769 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:15:55.769 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:15:55.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-code/x '--log-file=td/test-erasure-code/$name.log' '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --run-dir=td/test-erasure-code '--pid-file=td/test-erasure-code/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:15:55.788 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:34: run: get_asok_path mon.a 2026-02-17T08:15:55.788 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:15:55.788 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:15:55.788 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:15:55.788 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:55.788 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:15:55.788 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.41658/ceph-mon.a.asok 2026-02-17T08:15:55.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:34: run: CEPH_ARGS= 2026-02-17T08:15:55.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:34: run: ceph --admin-daemon /tmp/ceph-asok.41658/ceph-mon.a.asok log flush 2026-02-17T08:15:55.837 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:15:55.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:35: run: grep 'load: jerasure.*lrc' td/test-erasure-code/mon.a.log 2026-02-17T08:15:55.844 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:15:55.529+0000 7fba09020ec0 0 load: jerasure load: lrc 2026-02-17T08:15:55.845 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: seq 0 10 2026-02-17T08:15:55.848 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-17T08:15:55.848 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 0 2026-02-17T08:15:55.848 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code 2026-02-17T08:15:55.848 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:15:55.848 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:15:55.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:15:55.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code/0 2026-02-17T08:15:55.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-17T08:15:55.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:15:55.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:15:55.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:15:55.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/0' 2026-02-17T08:15:55.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/0/journal' 2026-02-17T08:15:55.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:15:55.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:15:55.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-17T08:15:55.850 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:15:55.850 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:15:55.850 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:15:55.850 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:15:55.850 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:15:55.850 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:15:55.850 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:15:55.850 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:15:55.850 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:15:55.850 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:15:55.850 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:15:55.850 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-17T08:15:55.850 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-17T08:15:55.850 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:15:55.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:15:55.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:15:55.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:15:55.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:15:55.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:15:55.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code/0 2026-02-17T08:15:55.852 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:15:55.852 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=763dd587-4095-4c7e-9792-af6b52bb2127 2026-02-17T08:15:55.852 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 763dd587-4095-4c7e-9792-af6b52bb2127' 2026-02-17T08:15:55.852 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 763dd587-4095-4c7e-9792-af6b52bb2127 2026-02-17T08:15:55.852 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:15:55.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQC7I5RpBkHiMhAA12GnZiDzRunpmiX5pvHNZQ== 2026-02-17T08:15:55.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQC7I5RpBkHiMhAA12GnZiDzRunpmiX5pvHNZQ=="}' 2026-02-17T08:15:55.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 763dd587-4095-4c7e-9792-af6b52bb2127 -i td/test-erasure-code/0/new.json 2026-02-17T08:15:55.968 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:15:55.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code/0/new.json 2026-02-17T08:15:55.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/0 --osd-journal=td/test-erasure-code/0/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC7I5RpBkHiMhAA12GnZiDzRunpmiX5pvHNZQ== --osd-uuid 763dd587-4095-4c7e-9792-af6b52bb2127 2026-02-17T08:15:55.992 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:55.985+0000 7fa2e12db8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:55.994 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:55.985+0000 7fa2e12db8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:55.995 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:55.985+0000 7fa2e12db8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:55.995 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:55.985+0000 7fa2e12db8c0 -1 bdev(0x563059523c00 td/test-erasure-code/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:15:55.995 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:55.985+0000 7fa2e12db8c0 -1 bluestore(td/test-erasure-code/0) _read_fsid unparsable uuid 2026-02-17T08:15:58.769 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code/0/keyring 2026-02-17T08:15:58.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:15:58.770 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:15:58.771 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:15:58.771 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:15:59.041 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:15:59.042 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:15:59.042 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/0 --osd-journal=td/test-erasure-code/0/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:15:59.042 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:15:59.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:15:59.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:15:59.063 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:59.053+0000 7f3e8d74d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:59.065 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:59.057+0000 7f3e8d74d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:59.066 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:15:59.057+0000 7f3e8d74d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:15:59.239 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:15:59.239 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:15:59.239 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:15:59.239 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:15:59.239 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:15:59.239 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:15:59.240 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:15:59.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:15:59.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:15:59.241 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:15:59.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:00.437 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:00.437 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:00.437 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:16:00.438 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:16:00.438 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:00.438 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:16:00.629 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:00.823 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:00.813+0000 7f3e8d74d8c0 -1 Falling back to public interface 2026-02-17T08:16:01.631 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:01.631 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:01.631 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:16:01.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:16:01.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:01.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:16:01.830 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:02.831 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:02.831 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:02.831 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:16:02.831 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:16:02.831 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:02.831 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:16:03.030 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:03.789 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:03.781+0000 7f3e8d74d8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:16:04.031 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:04.031 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:04.032 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:16:04.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:16:04.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:04.033 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:16:04.232 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:05.234 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:05.234 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:05.235 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:16:05.235 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:16:05.235 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:05.235 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:16:05.427 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2378223405,v1:127.0.0.1:6803/2378223405] [v2:127.0.0.1:6804/2378223405,v1:127.0.0.1:6805/2378223405] exists,up 763dd587-4095-4c7e-9792-af6b52bb2127 2026-02-17T08:16:05.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:16:05.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:16:05.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:16:05.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-17T08:16:05.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 1 2026-02-17T08:16:05.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code 2026-02-17T08:16:05.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:16:05.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T08:16:05.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:16:05.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code/1 2026-02-17T08:16:05.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-17T08:16:05.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:16:05.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:16:05.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:16:05.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/1' 2026-02-17T08:16:05.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/1/journal' 2026-02-17T08:16:05.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:16:05.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:16:05.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-17T08:16:05.432 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:16:05.432 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:16:05.432 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:16:05.432 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:16:05.433 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:16:05.433 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:16:05.433 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:16:05.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:16:05.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:16:05.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:16:05.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:16:05.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-17T08:16:05.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-17T08:16:05.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:16:05.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:16:05.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:16:05.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:16:05.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:16:05.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:16:05.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code/1 2026-02-17T08:16:05.434 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:16:05.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=167883d3-1a8f-4408-8d46-148ae2927ed8 2026-02-17T08:16:05.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 167883d3-1a8f-4408-8d46-148ae2927ed8' 2026-02-17T08:16:05.435 INFO:tasks.workunit.client.0.trial059.stdout:add osd1 167883d3-1a8f-4408-8d46-148ae2927ed8 2026-02-17T08:16:05.435 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:16:05.443 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDFI5RpSPX2GRAApUDHhbcQCCEzKdQ0paHI+A== 2026-02-17T08:16:05.443 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDFI5RpSPX2GRAApUDHhbcQCCEzKdQ0paHI+A=="}' 2026-02-17T08:16:05.443 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 167883d3-1a8f-4408-8d46-148ae2927ed8 -i td/test-erasure-code/1/new.json 2026-02-17T08:16:05.643 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:16:05.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code/1/new.json 2026-02-17T08:16:05.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/1 --osd-journal=td/test-erasure-code/1/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDFI5RpSPX2GRAApUDHhbcQCCEzKdQ0paHI+A== --osd-uuid 167883d3-1a8f-4408-8d46-148ae2927ed8 2026-02-17T08:16:05.669 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:05.661+0000 7fd7c245e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:05.670 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:05.661+0000 7fd7c245e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:05.671 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:05.661+0000 7fd7c245e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:05.672 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:05.661+0000 7fd7c245e8c0 -1 bdev(0x560c4e793c00 td/test-erasure-code/1/block) open stat got: (1) Operation not permitted 2026-02-17T08:16:05.672 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:05.661+0000 7fd7c245e8c0 -1 bluestore(td/test-erasure-code/1) _read_fsid unparsable uuid 2026-02-17T08:16:07.941 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code/1/keyring 2026-02-17T08:16:07.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:16:07.942 INFO:tasks.workunit.client.0.trial059.stdout:adding osd1 key to auth repository 2026-02-17T08:16:07.943 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T08:16:07.943 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:16:08.210 INFO:tasks.workunit.client.0.trial059.stdout:start osd.1 2026-02-17T08:16:08.211 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T08:16:08.211 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/1 --osd-journal=td/test-erasure-code/1/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:16:08.211 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:16:08.211 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:16:08.211 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:16:08.232 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:08.221+0000 7f8a8ca4f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:08.233 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:08.225+0000 7f8a8ca4f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:08.234 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:08.225+0000 7f8a8ca4f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:08.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T08:16:08.412 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:16:08.412 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:16:08.412 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:16:08.412 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:16:08.412 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:08.412 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:16:08.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:16:08.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:08.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:16:08.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:09.607 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:09.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:09.608 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:16:09.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:16:09.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:09.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:16:09.746 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:09.737+0000 7f8a8ca4f8c0 -1 Falling back to public interface 2026-02-17T08:16:09.804 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:10.805 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:10.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:10.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:16:10.806 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:16:10.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:10.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:16:10.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:11.997 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:11.997 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:11.998 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:16:11.998 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:16:11.998 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:11.998 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:16:12.191 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:12.801 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:12.793+0000 7f8a8ca4f8c0 -1 osd.1 0 log_to_monitors true 2026-02-17T08:16:13.192 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:13.192 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:13.193 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:16:13.193 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:16:13.194 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:13.194 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:16:13.386 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:14.387 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:14.388 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:14.388 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:16:14.389 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:16:14.389 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:14.389 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:16:14.581 INFO:tasks.workunit.client.0.trial059.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1410054345,v1:127.0.0.1:6811/1410054345] [v2:127.0.0.1:6812/1410054345,v1:127.0.0.1:6813/1410054345] exists,up 167883d3-1a8f-4408-8d46-148ae2927ed8 2026-02-17T08:16:14.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:16:14.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:16:14.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:16:14.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-17T08:16:14.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 2 2026-02-17T08:16:14.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code 2026-02-17T08:16:14.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:16:14.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T08:16:14.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:16:14.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code/2 2026-02-17T08:16:14.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-17T08:16:14.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:16:14.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:16:14.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:16:14.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/2' 2026-02-17T08:16:14.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/2/journal' 2026-02-17T08:16:14.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:16:14.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:16:14.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-17T08:16:14.586 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:16:14.586 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:16:14.586 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:16:14.586 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:16:14.586 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:16:14.586 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:16:14.586 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:16:14.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:16:14.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:16:14.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:16:14.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:16:14.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-17T08:16:14.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-17T08:16:14.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:16:14.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:16:14.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:16:14.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:16:14.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:16:14.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:16:14.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code/2 2026-02-17T08:16:14.588 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:16:14.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=cc115fc0-75a9-4972-b1fa-bb9e597a3c3d 2026-02-17T08:16:14.588 INFO:tasks.workunit.client.0.trial059.stdout:add osd2 cc115fc0-75a9-4972-b1fa-bb9e597a3c3d 2026-02-17T08:16:14.589 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 cc115fc0-75a9-4972-b1fa-bb9e597a3c3d' 2026-02-17T08:16:14.589 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:16:14.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDOI5RpJ3k+IxAAvgayn6DZc4IHzgOZBjTcKA== 2026-02-17T08:16:14.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDOI5RpJ3k+IxAAvgayn6DZc4IHzgOZBjTcKA=="}' 2026-02-17T08:16:14.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new cc115fc0-75a9-4972-b1fa-bb9e597a3c3d -i td/test-erasure-code/2/new.json 2026-02-17T08:16:14.798 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:16:14.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code/2/new.json 2026-02-17T08:16:14.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/2 --osd-journal=td/test-erasure-code/2/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDOI5RpJ3k+IxAAvgayn6DZc4IHzgOZBjTcKA== --osd-uuid cc115fc0-75a9-4972-b1fa-bb9e597a3c3d 2026-02-17T08:16:14.823 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:14.814+0000 7fc61b8938c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:14.825 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:14.818+0000 7fc61b8938c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:14.826 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:14.818+0000 7fc61b8938c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:14.826 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:14.818+0000 7fc61b8938c0 -1 bdev(0x5558d722bc00 td/test-erasure-code/2/block) open stat got: (1) Operation not permitted 2026-02-17T08:16:14.827 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:14.818+0000 7fc61b8938c0 -1 bluestore(td/test-erasure-code/2) _read_fsid unparsable uuid 2026-02-17T08:16:17.105 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code/2/keyring 2026-02-17T08:16:17.105 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:16:17.106 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T08:16:17.107 INFO:tasks.workunit.client.0.trial059.stdout:adding osd2 key to auth repository 2026-02-17T08:16:17.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:16:17.372 INFO:tasks.workunit.client.0.trial059.stdout:start osd.2 2026-02-17T08:16:17.373 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T08:16:17.373 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/2 --osd-journal=td/test-erasure-code/2/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:16:17.373 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:16:17.373 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:16:17.374 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:16:17.387 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:17.374+0000 7f8d4587e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:17.389 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:17.378+0000 7f8d4587e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:17.390 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:17.378+0000 7f8d4587e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:17.574 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T08:16:17.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:16:17.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:16:17.575 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:16:17.576 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:16:17.576 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:16:17.576 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:17.576 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:16:17.576 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:17.576 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:16:17.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:18.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:18.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:18.775 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:16:18.775 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:16:18.775 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:18.776 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:16:18.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:19.094 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:19.082+0000 7f8d4587e8c0 -1 Falling back to public interface 2026-02-17T08:16:19.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:19.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:19.969 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:16:19.970 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:16:19.970 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:19.970 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:16:20.168 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:21.170 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:21.170 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:21.171 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:16:21.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:16:21.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:21.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:16:21.364 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:22.111 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:22.098+0000 7f8d4587e8c0 -1 osd.2 0 log_to_monitors true 2026-02-17T08:16:22.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:22.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:22.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:16:22.366 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:16:22.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:22.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:16:22.566 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:23.567 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:23.567 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:23.567 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:16:23.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:16:23.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:23.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:16:23.761 INFO:tasks.workunit.client.0.trial059.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/540027120,v1:127.0.0.1:6819/540027120] [v2:127.0.0.1:6820/540027120,v1:127.0.0.1:6821/540027120] exists,up cc115fc0-75a9-4972-b1fa-bb9e597a3c3d 2026-02-17T08:16:23.764 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:16:23.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:16:23.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:16:23.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-17T08:16:23.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 3 2026-02-17T08:16:23.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code 2026-02-17T08:16:23.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:16:23.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2026-02-17T08:16:23.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:16:23.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code/3 2026-02-17T08:16:23.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-17T08:16:23.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:16:23.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:16:23.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:16:23.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/3' 2026-02-17T08:16:23.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/3/journal' 2026-02-17T08:16:23.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:16:23.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:16:23.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-17T08:16:23.766 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:16:23.766 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:16:23.766 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:16:23.766 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:16:23.767 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:16:23.767 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:16:23.767 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:16:23.767 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:16:23.767 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:16:23.767 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:16:23.767 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:16:23.767 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-17T08:16:23.767 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-17T08:16:23.767 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:16:23.767 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:16:23.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:16:23.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:16:23.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:16:23.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:16:23.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code/3 2026-02-17T08:16:23.768 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:16:23.769 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=5df223e2-4756-4df5-80a6-f58675fbdacb 2026-02-17T08:16:23.769 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 5df223e2-4756-4df5-80a6-f58675fbdacb' 2026-02-17T08:16:23.769 INFO:tasks.workunit.client.0.trial059.stdout:add osd3 5df223e2-4756-4df5-80a6-f58675fbdacb 2026-02-17T08:16:23.769 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:16:23.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDXI5RphScALhAAsVxycqsmw5P3pGZ5+mxesA== 2026-02-17T08:16:23.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDXI5RphScALhAAsVxycqsmw5P3pGZ5+mxesA=="}' 2026-02-17T08:16:23.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 5df223e2-4756-4df5-80a6-f58675fbdacb -i td/test-erasure-code/3/new.json 2026-02-17T08:16:23.986 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:16:23.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code/3/new.json 2026-02-17T08:16:23.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/3 --osd-journal=td/test-erasure-code/3/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDXI5RphScALhAAsVxycqsmw5P3pGZ5+mxesA== --osd-uuid 5df223e2-4756-4df5-80a6-f58675fbdacb 2026-02-17T08:16:24.011 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:24.003+0000 7f880f6088c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:24.013 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:24.003+0000 7f880f6088c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:24.014 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:24.003+0000 7f880f6088c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:24.014 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:24.003+0000 7f880f6088c0 -1 bdev(0x55a721d0dc00 td/test-erasure-code/3/block) open stat got: (1) Operation not permitted 2026-02-17T08:16:24.014 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:24.003+0000 7f880f6088c0 -1 bluestore(td/test-erasure-code/3) _read_fsid unparsable uuid 2026-02-17T08:16:26.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code/3/keyring 2026-02-17T08:16:26.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:16:26.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2026-02-17T08:16:26.301 INFO:tasks.workunit.client.0.trial059.stdout:adding osd3 key to auth repository 2026-02-17T08:16:26.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:16:26.564 INFO:tasks.workunit.client.0.trial059.stdout:start osd.3 2026-02-17T08:16:26.565 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2026-02-17T08:16:26.565 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/3 --osd-journal=td/test-erasure-code/3/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:16:26.565 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:16:26.566 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:16:26.566 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:16:26.586 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:26.575+0000 7fc48359f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:26.588 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:26.579+0000 7fc48359f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:26.589 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:26.579+0000 7fc48359f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:26.762 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2026-02-17T08:16:26.762 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:16:26.762 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T08:16:26.762 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:16:26.762 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:16:26.762 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:26.763 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:16:26.763 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:16:26.763 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:26.764 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:16:26.961 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:27.962 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:27.963 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:27.963 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:16:27.964 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:16:27.964 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:27.964 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:16:28.088 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:28.079+0000 7fc48359f8c0 -1 Falling back to public interface 2026-02-17T08:16:28.165 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:29.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:29.167 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:29.167 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:16:29.168 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:16:29.168 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:29.168 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:16:29.362 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:30.363 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:30.364 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:30.364 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:16:30.364 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:16:30.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:30.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:16:30.556 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:31.090 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:31.079+0000 7fc48359f8c0 -1 osd.3 0 log_to_monitors true 2026-02-17T08:16:31.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:31.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:31.558 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:16:31.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:16:31.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:31.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:16:31.749 INFO:tasks.workunit.client.0.trial059.stdout:osd.3 up in weight 1 up_from 17 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2326279064,v1:127.0.0.1:6827/2326279064] [v2:127.0.0.1:6828/2326279064,v1:127.0.0.1:6829/2326279064] exists,up 5df223e2-4756-4df5-80a6-f58675fbdacb 2026-02-17T08:16:31.751 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:16:31.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:16:31.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:16:31.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-17T08:16:31.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 4 2026-02-17T08:16:31.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code 2026-02-17T08:16:31.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:16:31.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2026-02-17T08:16:31.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:16:31.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code/4 2026-02-17T08:16:31.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-17T08:16:31.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:16:31.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:16:31.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:16:31.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/4' 2026-02-17T08:16:31.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/4/journal' 2026-02-17T08:16:31.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:16:31.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:16:31.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-17T08:16:31.753 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:16:31.753 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:16:31.753 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:16:31.753 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:16:31.753 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:16:31.754 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:16:31.754 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:16:31.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:16:31.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:16:31.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:16:31.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:16:31.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-17T08:16:31.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-17T08:16:31.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:16:31.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:16:31.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:16:31.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:16:31.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:16:31.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:16:31.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code/4 2026-02-17T08:16:31.755 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:16:31.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=fc4f30a8-d8d4-4c51-8344-9af0f74f0bd1 2026-02-17T08:16:31.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 fc4f30a8-d8d4-4c51-8344-9af0f74f0bd1' 2026-02-17T08:16:31.756 INFO:tasks.workunit.client.0.trial059.stdout:add osd4 fc4f30a8-d8d4-4c51-8344-9af0f74f0bd1 2026-02-17T08:16:31.756 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:16:31.764 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDfI5RpI+09LRAADFf/iKY9MiGC2puzKVmobw== 2026-02-17T08:16:31.764 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDfI5RpI+09LRAADFf/iKY9MiGC2puzKVmobw=="}' 2026-02-17T08:16:31.764 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new fc4f30a8-d8d4-4c51-8344-9af0f74f0bd1 -i td/test-erasure-code/4/new.json 2026-02-17T08:16:31.965 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:16:31.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code/4/new.json 2026-02-17T08:16:31.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/4 --osd-journal=td/test-erasure-code/4/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDfI5RpI+09LRAADFf/iKY9MiGC2puzKVmobw== --osd-uuid fc4f30a8-d8d4-4c51-8344-9af0f74f0bd1 2026-02-17T08:16:31.996 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:31.987+0000 7f360d74d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:31.998 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:31.987+0000 7f360d74d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:31.999 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:31.991+0000 7f360d74d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:31.999 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:31.991+0000 7f360d74d8c0 -1 bdev(0x5580c6083c00 td/test-erasure-code/4/block) open stat got: (1) Operation not permitted 2026-02-17T08:16:31.999 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:31.991+0000 7f360d74d8c0 -1 bluestore(td/test-erasure-code/4) _read_fsid unparsable uuid 2026-02-17T08:16:34.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code/4/keyring 2026-02-17T08:16:34.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:16:34.301 INFO:tasks.workunit.client.0.trial059.stdout:adding osd4 key to auth repository 2026-02-17T08:16:34.302 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2026-02-17T08:16:34.302 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:16:34.567 INFO:tasks.workunit.client.0.trial059.stdout:start osd.4 2026-02-17T08:16:34.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2026-02-17T08:16:34.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/4 --osd-journal=td/test-erasure-code/4/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:16:34.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:16:34.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:16:34.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:16:34.588 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:34.579+0000 7f827fd888c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:34.590 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:34.579+0000 7f827fd888c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:34.591 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:34.583+0000 7f827fd888c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:34.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2026-02-17T08:16:34.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:16:34.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2026-02-17T08:16:34.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:16:34.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:16:34.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:34.768 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:16:34.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:16:34.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:34.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:16:34.964 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:35.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:35.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:35.966 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:16:35.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:16:35.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:35.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:16:36.167 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:36.328 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:36.319+0000 7f827fd888c0 -1 Falling back to public interface 2026-02-17T08:16:37.168 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:37.169 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:37.169 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:16:37.169 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:16:37.170 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:37.170 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:16:37.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:38.367 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:38.367 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:38.368 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:16:38.368 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:16:38.369 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:38.369 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:16:38.560 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:39.351 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:39.343+0000 7f827fd888c0 -1 osd.4 0 log_to_monitors true 2026-02-17T08:16:39.561 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:39.561 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:39.561 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:16:39.562 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:16:39.562 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:39.562 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:16:39.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:40.757 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:40.758 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:40.758 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:16:40.759 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:16:40.759 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:40.759 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:16:40.952 INFO:tasks.workunit.client.0.trial059.stdout:osd.4 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/3864844852,v1:127.0.0.1:6835/3864844852] [v2:127.0.0.1:6836/3864844852,v1:127.0.0.1:6837/3864844852] exists,up fc4f30a8-d8d4-4c51-8344-9af0f74f0bd1 2026-02-17T08:16:40.955 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:16:40.955 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:16:40.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:16:40.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-17T08:16:40.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 5 2026-02-17T08:16:40.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code 2026-02-17T08:16:40.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:16:40.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=5 2026-02-17T08:16:40.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:16:40.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code/5 2026-02-17T08:16:40.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-17T08:16:40.957 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:16:40.957 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:16:40.957 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:16:40.957 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/5' 2026-02-17T08:16:40.957 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/5/journal' 2026-02-17T08:16:40.957 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:16:40.957 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:16:40.957 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-17T08:16:40.957 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:16:40.957 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:16:40.957 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:16:40.957 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:16:40.958 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:16:40.958 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:16:40.958 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:16:40.958 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:16:40.958 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:16:40.958 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:16:40.958 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:16:40.958 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-17T08:16:40.958 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-17T08:16:40.958 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:16:40.958 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:16:40.958 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:16:40.958 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:16:40.959 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:16:40.959 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:16:40.959 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code/5 2026-02-17T08:16:40.959 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:16:40.960 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=bf740c13-17d8-43b9-9ecf-f1a55a11692d 2026-02-17T08:16:40.960 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd5 bf740c13-17d8-43b9-9ecf-f1a55a11692d' 2026-02-17T08:16:40.960 INFO:tasks.workunit.client.0.trial059.stdout:add osd5 bf740c13-17d8-43b9-9ecf-f1a55a11692d 2026-02-17T08:16:40.960 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:16:40.969 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDoI5Rpudh0ORAAQINIzZPQVMV7FUe7w83kIA== 2026-02-17T08:16:40.969 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDoI5Rpudh0ORAAQINIzZPQVMV7FUe7w83kIA=="}' 2026-02-17T08:16:40.969 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new bf740c13-17d8-43b9-9ecf-f1a55a11692d -i td/test-erasure-code/5/new.json 2026-02-17T08:16:41.168 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:16:41.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code/5/new.json 2026-02-17T08:16:41.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 5 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/5 --osd-journal=td/test-erasure-code/5/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDoI5Rpudh0ORAAQINIzZPQVMV7FUe7w83kIA== --osd-uuid bf740c13-17d8-43b9-9ecf-f1a55a11692d 2026-02-17T08:16:41.194 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:41.183+0000 7f39b81bb8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:41.195 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:41.187+0000 7f39b81bb8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:41.196 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:41.187+0000 7f39b81bb8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:41.197 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:41.187+0000 7f39b81bb8c0 -1 bdev(0x559151813c00 td/test-erasure-code/5/block) open stat got: (1) Operation not permitted 2026-02-17T08:16:41.197 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:41.187+0000 7f39b81bb8c0 -1 bluestore(td/test-erasure-code/5) _read_fsid unparsable uuid 2026-02-17T08:16:43.467 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code/5/keyring 2026-02-17T08:16:43.467 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:16:43.467 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd5 key to auth repository 2026-02-17T08:16:43.468 INFO:tasks.workunit.client.0.trial059.stdout:adding osd5 key to auth repository 2026-02-17T08:16:43.468 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:16:43.734 INFO:tasks.workunit.client.0.trial059.stdout:start osd.5 2026-02-17T08:16:43.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.5 2026-02-17T08:16:43.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 5 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/5 --osd-journal=td/test-erasure-code/5/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:16:43.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:16:43.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:16:43.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:16:43.756 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:43.748+0000 7f262f6c78c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:43.758 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:43.752+0000 7f262f6c78c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:43.759 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:43.752+0000 7f262f6c78c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:43.932 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 5 2026-02-17T08:16:43.932 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:16:43.932 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=5 2026-02-17T08:16:43.932 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:16:43.932 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:16:43.932 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:43.933 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:16:43.933 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:16:43.933 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:43.933 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:16:44.128 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:45.130 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:45.130 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:45.130 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:16:45.131 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:16:45.131 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:45.131 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:16:45.264 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:45.256+0000 7f262f6c78c0 -1 Falling back to public interface 2026-02-17T08:16:45.326 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:46.328 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:46.328 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:46.328 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:16:46.329 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:16:46.329 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:46.329 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:16:46.526 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:47.527 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:47.528 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:47.528 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:16:47.529 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:16:47.529 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:47.529 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:16:47.722 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:48.267 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:48.260+0000 7f262f6c78c0 -1 osd.5 0 log_to_monitors true 2026-02-17T08:16:48.723 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:48.723 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:48.723 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:16:48.724 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:16:48.725 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:48.725 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:16:48.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:49.921 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:49.921 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:49.922 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:16:49.922 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:16:49.923 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:49.923 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:16:50.118 INFO:tasks.workunit.client.0.trial059.stdout:osd.5 up in weight 1 up_from 27 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/3710977325,v1:127.0.0.1:6843/3710977325] [v2:127.0.0.1:6844/3710977325,v1:127.0.0.1:6845/3710977325] exists,up bf740c13-17d8-43b9-9ecf-f1a55a11692d 2026-02-17T08:16:50.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:16:50.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:16:50.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:16:50.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-17T08:16:50.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 6 2026-02-17T08:16:50.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code 2026-02-17T08:16:50.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:16:50.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=6 2026-02-17T08:16:50.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:16:50.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code/6 2026-02-17T08:16:50.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-17T08:16:50.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:16:50.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:16:50.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:16:50.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/6' 2026-02-17T08:16:50.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/6/journal' 2026-02-17T08:16:50.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:16:50.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:16:50.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-17T08:16:50.125 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:16:50.125 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:16:50.126 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:16:50.126 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:16:50.126 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:16:50.126 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:16:50.126 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:16:50.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:16:50.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:16:50.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:16:50.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:16:50.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-17T08:16:50.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-17T08:16:50.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:16:50.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:16:50.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:16:50.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:16:50.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:16:50.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:16:50.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code/6 2026-02-17T08:16:50.127 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:16:50.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=36445e95-af28-4ddf-842b-35d10821674c 2026-02-17T08:16:50.128 INFO:tasks.workunit.client.0.trial059.stdout:add osd6 36445e95-af28-4ddf-842b-35d10821674c 2026-02-17T08:16:50.129 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd6 36445e95-af28-4ddf-842b-35d10821674c' 2026-02-17T08:16:50.129 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:16:50.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDyI5Rp1qPUBxAAepeTRa5JjOiW5MhQWdtEAQ== 2026-02-17T08:16:50.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDyI5Rp1qPUBxAAepeTRa5JjOiW5MhQWdtEAQ=="}' 2026-02-17T08:16:50.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 36445e95-af28-4ddf-842b-35d10821674c -i td/test-erasure-code/6/new.json 2026-02-17T08:16:50.338 INFO:tasks.workunit.client.0.trial059.stdout:6 2026-02-17T08:16:50.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code/6/new.json 2026-02-17T08:16:50.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 6 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/6 --osd-journal=td/test-erasure-code/6/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDyI5Rp1qPUBxAAepeTRa5JjOiW5MhQWdtEAQ== --osd-uuid 36445e95-af28-4ddf-842b-35d10821674c 2026-02-17T08:16:50.363 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:50.356+0000 7f0ad21278c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:50.364 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:50.356+0000 7f0ad21278c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:50.365 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:50.356+0000 7f0ad21278c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:50.366 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:50.356+0000 7f0ad21278c0 -1 bdev(0x556015823c00 td/test-erasure-code/6/block) open stat got: (1) Operation not permitted 2026-02-17T08:16:50.366 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:50.356+0000 7f0ad21278c0 -1 bluestore(td/test-erasure-code/6) _read_fsid unparsable uuid 2026-02-17T08:16:52.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code/6/keyring 2026-02-17T08:16:52.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:16:52.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd6 key to auth repository 2026-02-17T08:16:52.656 INFO:tasks.workunit.client.0.trial059.stdout:adding osd6 key to auth repository 2026-02-17T08:16:52.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:16:52.924 INFO:tasks.workunit.client.0.trial059.stdout:start osd.6 2026-02-17T08:16:52.925 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.6 2026-02-17T08:16:52.925 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 6 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/6 --osd-journal=td/test-erasure-code/6/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:16:52.925 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:16:52.925 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:16:52.925 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:16:52.946 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:52.940+0000 7f9ceb8d58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:52.948 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:52.940+0000 7f9ceb8d58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:52.948 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:52.940+0000 7f9ceb8d58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:53.121 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 6 2026-02-17T08:16:53.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:16:53.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=6 2026-02-17T08:16:53.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:16:53.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:16:53.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:53.122 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:16:53.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:16:53.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:53.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:16:53.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:54.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:54.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:54.322 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:16:54.322 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:16:54.323 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:54.323 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:16:54.419 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:54.412+0000 7f9ceb8d58c0 -1 Falling back to public interface 2026-02-17T08:16:54.512 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:55.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:55.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:55.514 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:16:55.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:16:55.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:55.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:16:55.704 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:56.705 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:56.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:56.706 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:16:56.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:16:56.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:56.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:16:56.899 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:16:57.402 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:57.396+0000 7f9ceb8d58c0 -1 osd.6 0 log_to_monitors true 2026-02-17T08:16:57.901 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:16:57.901 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:16:57.902 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:16:57.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:16:57.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:16:57.903 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:16:58.095 INFO:tasks.workunit.client.0.trial059.stdout:osd.6 up in weight 1 up_from 31 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/266602218,v1:127.0.0.1:6851/266602218] [v2:127.0.0.1:6852/266602218,v1:127.0.0.1:6853/266602218] exists,up 36445e95-af28-4ddf-842b-35d10821674c 2026-02-17T08:16:58.099 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:16:58.099 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:16:58.099 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:16:58.099 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-17T08:16:58.099 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 7 2026-02-17T08:16:58.099 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code 2026-02-17T08:16:58.099 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:16:58.099 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=7 2026-02-17T08:16:58.100 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:16:58.100 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code/7 2026-02-17T08:16:58.100 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-17T08:16:58.100 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:16:58.100 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:16:58.100 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:16:58.100 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/7' 2026-02-17T08:16:58.100 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/7/journal' 2026-02-17T08:16:58.100 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:16:58.100 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:16:58.100 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-17T08:16:58.100 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:16:58.101 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:16:58.101 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:16:58.101 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:16:58.101 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:16:58.101 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:16:58.101 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:16:58.101 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:16:58.101 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:16:58.101 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:16:58.101 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:16:58.101 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-17T08:16:58.101 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-17T08:16:58.102 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:16:58.102 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:16:58.102 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:16:58.102 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:16:58.102 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:16:58.102 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:16:58.102 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code/7 2026-02-17T08:16:58.103 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:16:58.103 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=27165c4e-f480-4af3-8669-a1817f365ef1 2026-02-17T08:16:58.103 INFO:tasks.workunit.client.0.trial059.stdout:add osd7 27165c4e-f480-4af3-8669-a1817f365ef1 2026-02-17T08:16:58.104 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd7 27165c4e-f480-4af3-8669-a1817f365ef1' 2026-02-17T08:16:58.104 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:16:58.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQD6I5Rp9rhlBhAAXbrGUoE4Gd2S9lv7krUeVg== 2026-02-17T08:16:58.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQD6I5Rp9rhlBhAAXbrGUoE4Gd2S9lv7krUeVg=="}' 2026-02-17T08:16:58.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 27165c4e-f480-4af3-8669-a1817f365ef1 -i td/test-erasure-code/7/new.json 2026-02-17T08:16:58.315 INFO:tasks.workunit.client.0.trial059.stdout:7 2026-02-17T08:16:58.323 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code/7/new.json 2026-02-17T08:16:58.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 7 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/7 --osd-journal=td/test-erasure-code/7/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD6I5Rp9rhlBhAAXbrGUoE4Gd2S9lv7krUeVg== --osd-uuid 27165c4e-f480-4af3-8669-a1817f365ef1 2026-02-17T08:16:58.339 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:58.332+0000 7f224b5c48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:58.340 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:58.332+0000 7f224b5c48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:58.341 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:58.336+0000 7f224b5c48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:16:58.342 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:58.336+0000 7f224b5c48c0 -1 bdev(0x55df10901c00 td/test-erasure-code/7/block) open stat got: (1) Operation not permitted 2026-02-17T08:16:58.342 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:16:58.336+0000 7f224b5c48c0 -1 bluestore(td/test-erasure-code/7) _read_fsid unparsable uuid 2026-02-17T08:17:00.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code/7/keyring 2026-02-17T08:17:00.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:17:00.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd7 key to auth repository 2026-02-17T08:17:00.634 INFO:tasks.workunit.client.0.trial059.stdout:adding osd7 key to auth repository 2026-02-17T08:17:00.634 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code/7/keyring auth add osd.7 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:17:00.893 INFO:tasks.workunit.client.0.trial059.stdout:start osd.7 2026-02-17T08:17:00.894 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.7 2026-02-17T08:17:00.895 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 7 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/7 --osd-journal=td/test-erasure-code/7/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:17:00.895 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:17:00.895 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:17:00.895 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:17:00.917 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:00.908+0000 7f9979b138c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:17:00.919 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:00.912+0000 7f9979b138c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:17:00.920 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:00.912+0000 7f9979b138c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:17:01.090 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 7 2026-02-17T08:17:01.090 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:17:01.090 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=7 2026-02-17T08:17:01.091 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:17:01.091 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:17:01.091 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:01.091 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:17:01.091 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:17:01.091 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:01.091 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2026-02-17T08:17:01.283 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:17:02.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:17:02.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:02.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:17:02.285 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:17:02.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:02.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2026-02-17T08:17:02.423 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:02.416+0000 7f9979b138c0 -1 Falling back to public interface 2026-02-17T08:17:02.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:17:03.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:17:03.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:03.480 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:17:03.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:17:03.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:03.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2026-02-17T08:17:03.675 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:17:04.676 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:17:04.676 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:04.676 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:17:04.677 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:17:04.677 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:04.677 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2026-02-17T08:17:04.866 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:17:05.677 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:05.668+0000 7f9979b138c0 -1 osd.7 0 log_to_monitors true 2026-02-17T08:17:05.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:17:05.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:05.867 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:17:05.868 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:17:05.868 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:05.868 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2026-02-17T08:17:06.084 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:17:07.085 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:17:07.086 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:07.086 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:17:07.086 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:17:07.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:07.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2026-02-17T08:17:07.275 INFO:tasks.workunit.client.0.trial059.stdout:osd.7 up in weight 1 up_from 35 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6858/478657673,v1:127.0.0.1:6859/478657673] [v2:127.0.0.1:6860/478657673,v1:127.0.0.1:6861/478657673] exists,up 27165c4e-f480-4af3-8669-a1817f365ef1 2026-02-17T08:17:07.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:17:07.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:17:07.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:17:07.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-17T08:17:07.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 8 2026-02-17T08:17:07.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code 2026-02-17T08:17:07.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:17:07.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=8 2026-02-17T08:17:07.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:17:07.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code/8 2026-02-17T08:17:07.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-17T08:17:07.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:17:07.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:17:07.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:17:07.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/8' 2026-02-17T08:17:07.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/8/journal' 2026-02-17T08:17:07.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:17:07.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:17:07.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-17T08:17:07.280 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:17:07.280 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:17:07.280 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:17:07.280 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:17:07.280 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:17:07.280 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:17:07.280 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:17:07.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:17:07.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:17:07.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:17:07.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:17:07.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-17T08:17:07.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-17T08:17:07.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:17:07.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:17:07.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:17:07.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:17:07.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:17:07.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:17:07.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code/8 2026-02-17T08:17:07.282 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:17:07.282 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=4a06232b-0c60-4b14-96b3-589ecde5dc20 2026-02-17T08:17:07.283 INFO:tasks.workunit.client.0.trial059.stdout:add osd8 4a06232b-0c60-4b14-96b3-589ecde5dc20 2026-02-17T08:17:07.283 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd8 4a06232b-0c60-4b14-96b3-589ecde5dc20' 2026-02-17T08:17:07.283 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:17:07.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQADJJRpnlADERAAD3+9recGbrkNs5OndwxXJA== 2026-02-17T08:17:07.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQADJJRpnlADERAAD3+9recGbrkNs5OndwxXJA=="}' 2026-02-17T08:17:07.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 4a06232b-0c60-4b14-96b3-589ecde5dc20 -i td/test-erasure-code/8/new.json 2026-02-17T08:17:07.485 INFO:tasks.workunit.client.0.trial059.stdout:8 2026-02-17T08:17:07.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code/8/new.json 2026-02-17T08:17:07.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 8 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/8 --osd-journal=td/test-erasure-code/8/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQADJJRpnlADERAAD3+9recGbrkNs5OndwxXJA== --osd-uuid 4a06232b-0c60-4b14-96b3-589ecde5dc20 2026-02-17T08:17:07.518 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:07.512+0000 7fd0f75c48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:17:07.519 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:07.512+0000 7fd0f75c48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:17:07.520 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:07.512+0000 7fd0f75c48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:17:07.521 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:07.512+0000 7fd0f75c48c0 -1 bdev(0x5644d1cb3c00 td/test-erasure-code/8/block) open stat got: (1) Operation not permitted 2026-02-17T08:17:07.521 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:07.512+0000 7fd0f75c48c0 -1 bluestore(td/test-erasure-code/8) _read_fsid unparsable uuid 2026-02-17T08:17:09.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code/8/keyring 2026-02-17T08:17:09.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:17:09.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd8 key to auth repository 2026-02-17T08:17:09.844 INFO:tasks.workunit.client.0.trial059.stdout:adding osd8 key to auth repository 2026-02-17T08:17:09.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code/8/keyring auth add osd.8 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:17:10.114 INFO:tasks.workunit.client.0.trial059.stdout:start osd.8 2026-02-17T08:17:10.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.8 2026-02-17T08:17:10.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 8 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/8 --osd-journal=td/test-erasure-code/8/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:17:10.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:17:10.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:17:10.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:17:10.136 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:10.128+0000 7fba429368c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:17:10.138 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:10.132+0000 7fba429368c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:17:10.139 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:10.132+0000 7fba429368c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:17:10.313 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 8 2026-02-17T08:17:10.313 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:17:10.313 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=8 2026-02-17T08:17:10.313 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:17:10.313 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:17:10.313 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:10.314 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:17:10.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:17:10.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:10.315 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2026-02-17T08:17:10.511 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:17:11.513 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:17:11.513 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:11.514 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:17:11.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:17:11.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:11.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2026-02-17T08:17:11.643 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:11.636+0000 7fba429368c0 -1 Falling back to public interface 2026-02-17T08:17:11.709 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:17:12.711 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:17:12.711 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:12.711 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:17:12.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:17:12.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:12.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2026-02-17T08:17:12.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:17:13.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:17:13.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:13.904 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:17:13.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:17:13.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:13.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2026-02-17T08:17:14.100 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:17:14.913 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:14.904+0000 7fba429368c0 -1 osd.8 0 log_to_monitors true 2026-02-17T08:17:15.101 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:17:15.102 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:15.102 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:17:15.103 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:17:15.103 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:15.103 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2026-02-17T08:17:15.297 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:17:16.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:17:16.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:16.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:17:16.300 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:17:16.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:16.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2026-02-17T08:17:16.492 INFO:tasks.workunit.client.0.trial059.stdout:osd.8 up in weight 1 up_from 39 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6866/4116783769,v1:127.0.0.1:6867/4116783769] [v2:127.0.0.1:6868/4116783769,v1:127.0.0.1:6869/4116783769] exists,up 4a06232b-0c60-4b14-96b3-589ecde5dc20 2026-02-17T08:17:16.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:17:16.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:17:16.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:17:16.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-17T08:17:16.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 9 2026-02-17T08:17:16.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code 2026-02-17T08:17:16.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:17:16.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=9 2026-02-17T08:17:16.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:17:16.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code/9 2026-02-17T08:17:16.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-17T08:17:16.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:17:16.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:17:16.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:17:16.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/9' 2026-02-17T08:17:16.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/9/journal' 2026-02-17T08:17:16.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:17:16.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:17:16.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-17T08:17:16.497 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:17:16.497 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:17:16.497 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:17:16.497 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:17:16.497 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:17:16.497 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:17:16.497 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:17:16.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:17:16.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:17:16.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:17:16.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:17:16.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-17T08:17:16.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-17T08:17:16.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:17:16.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:17:16.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:17:16.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:17:16.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:17:16.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:17:16.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code/9 2026-02-17T08:17:16.499 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:17:16.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=ecbc4e41-54f3-4945-9c40-3f81811b5d29 2026-02-17T08:17:16.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd9 ecbc4e41-54f3-4945-9c40-3f81811b5d29' 2026-02-17T08:17:16.500 INFO:tasks.workunit.client.0.trial059.stdout:add osd9 ecbc4e41-54f3-4945-9c40-3f81811b5d29 2026-02-17T08:17:16.500 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:17:16.508 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAMJJRp7ZkHHhAAVaVpaQYqWueQh7B20G3yig== 2026-02-17T08:17:16.508 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAMJJRp7ZkHHhAAVaVpaQYqWueQh7B20G3yig=="}' 2026-02-17T08:17:16.508 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new ecbc4e41-54f3-4945-9c40-3f81811b5d29 -i td/test-erasure-code/9/new.json 2026-02-17T08:17:16.712 INFO:tasks.workunit.client.0.trial059.stdout:9 2026-02-17T08:17:16.721 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code/9/new.json 2026-02-17T08:17:16.722 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 9 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/9 --osd-journal=td/test-erasure-code/9/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAMJJRp7ZkHHhAAVaVpaQYqWueQh7B20G3yig== --osd-uuid ecbc4e41-54f3-4945-9c40-3f81811b5d29 2026-02-17T08:17:16.746 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:16.740+0000 7f04e795f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:17:16.748 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:16.740+0000 7f04e795f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:17:16.749 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:16.740+0000 7f04e795f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:17:16.749 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:16.740+0000 7f04e795f8c0 -1 bdev(0x5625b56dfc00 td/test-erasure-code/9/block) open stat got: (1) Operation not permitted 2026-02-17T08:17:16.749 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:16.744+0000 7f04e795f8c0 -1 bluestore(td/test-erasure-code/9) _read_fsid unparsable uuid 2026-02-17T08:17:19.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code/9/keyring 2026-02-17T08:17:19.075 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:17:19.075 INFO:tasks.workunit.client.0.trial059.stdout:adding osd9 key to auth repository 2026-02-17T08:17:19.076 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd9 key to auth repository 2026-02-17T08:17:19.076 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code/9/keyring auth add osd.9 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:17:19.342 INFO:tasks.workunit.client.0.trial059.stdout:start osd.9 2026-02-17T08:17:19.343 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.9 2026-02-17T08:17:19.343 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 9 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/9 --osd-journal=td/test-erasure-code/9/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:17:19.344 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:17:19.344 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:17:19.344 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:17:19.364 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:19.356+0000 7fec79abd8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:17:19.366 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:19.360+0000 7fec79abd8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:17:19.366 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:19.360+0000 7fec79abd8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:17:19.539 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 9 2026-02-17T08:17:19.539 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:17:19.539 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=9 2026-02-17T08:17:19.539 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:17:19.540 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:17:19.540 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:19.540 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:17:19.541 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:17:19.541 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:19.541 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2026-02-17T08:17:19.731 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:17:20.732 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:17:20.732 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:20.733 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:17:20.733 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:17:20.734 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:20.734 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2026-02-17T08:17:20.866 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:20.860+0000 7fec79abd8c0 -1 Falling back to public interface 2026-02-17T08:17:20.930 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:17:21.931 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:17:21.931 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:21.931 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:17:21.931 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:17:21.932 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:21.932 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2026-02-17T08:17:22.130 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:17:23.131 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:17:23.131 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:23.132 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:17:23.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:17:23.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:23.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2026-02-17T08:17:23.327 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:17:24.176 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:24.169+0000 7fec79abd8c0 -1 osd.9 0 log_to_monitors true 2026-02-17T08:17:24.329 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:17:24.329 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:24.329 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:17:24.330 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:17:24.330 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:24.330 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2026-02-17T08:17:24.527 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:17:25.528 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:17:25.529 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:25.529 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:17:25.529 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:17:25.530 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:25.530 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2026-02-17T08:17:25.722 INFO:tasks.workunit.client.0.trial059.stdout:osd.9 up in weight 1 up_from 43 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6874/1059586845,v1:127.0.0.1:6875/1059586845] [v2:127.0.0.1:6876/1059586845,v1:127.0.0.1:6877/1059586845] exists,up ecbc4e41-54f3-4945-9c40-3f81811b5d29 2026-02-17T08:17:25.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:17:25.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:17:25.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:17:25.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:36: run: for id in $(seq 0 10) 2026-02-17T08:17:25.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:37: run: run_osd td/test-erasure-code 10 2026-02-17T08:17:25.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-code 2026-02-17T08:17:25.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:17:25.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=10 2026-02-17T08:17:25.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:17:25.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-code/10 2026-02-17T08:17:25.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-17T08:17:25.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:17:25.728 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:17:25.728 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:17:25.728 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-code/10' 2026-02-17T08:17:25.728 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-code/10/journal' 2026-02-17T08:17:25.728 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:17:25.728 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:17:25.728 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-17T08:17:25.729 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:17:25.729 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:17:25.729 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:17:25.729 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:17:25.729 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:17:25.729 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:17:25.729 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:17:25.729 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:17:25.729 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:17:25.729 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:17:25.729 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:17:25.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-17T08:17:25.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-17T08:17:25.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:17:25.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:17:25.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:17:25.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:17:25.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:17:25.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:17:25.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-code/10 2026-02-17T08:17:25.731 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:17:25.731 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=3fde5edd-d5ed-4422-8724-7db65c2b3b29 2026-02-17T08:17:25.731 INFO:tasks.workunit.client.0.trial059.stdout:add osd10 3fde5edd-d5ed-4422-8724-7db65c2b3b29 2026-02-17T08:17:25.732 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd10 3fde5edd-d5ed-4422-8724-7db65c2b3b29' 2026-02-17T08:17:25.732 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:17:25.739 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAVJJRpNQ/YKxAAB+YUVk6DdkGFTw5vsJtfcA== 2026-02-17T08:17:25.739 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAVJJRpNQ/YKxAAB+YUVk6DdkGFTw5vsJtfcA=="}' 2026-02-17T08:17:25.739 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 3fde5edd-d5ed-4422-8724-7db65c2b3b29 -i td/test-erasure-code/10/new.json 2026-02-17T08:17:25.939 INFO:tasks.workunit.client.0.trial059.stdout:10 2026-02-17T08:17:25.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-code/10/new.json 2026-02-17T08:17:25.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 10 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/10 --osd-journal=td/test-erasure-code/10/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAVJJRpNQ/YKxAAB+YUVk6DdkGFTw5vsJtfcA== --osd-uuid 3fde5edd-d5ed-4422-8724-7db65c2b3b29 2026-02-17T08:17:25.971 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:25.965+0000 7f6ac33008c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:17:25.973 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:25.969+0000 7f6ac33008c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:17:25.974 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:25.969+0000 7f6ac33008c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:17:25.975 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:25.969+0000 7f6ac33008c0 -1 bdev(0x562c76f29c00 td/test-erasure-code/10/block) open stat got: (1) Operation not permitted 2026-02-17T08:17:25.975 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:25.969+0000 7f6ac33008c0 -1 bluestore(td/test-erasure-code/10) _read_fsid unparsable uuid 2026-02-17T08:17:28.276 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-code/10/keyring 2026-02-17T08:17:28.276 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:17:28.276 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd10 key to auth repository 2026-02-17T08:17:28.277 INFO:tasks.workunit.client.0.trial059.stdout:adding osd10 key to auth repository 2026-02-17T08:17:28.277 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-code/10/keyring auth add osd.10 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:17:28.540 INFO:tasks.workunit.client.0.trial059.stdout:start osd.10 2026-02-17T08:17:28.540 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.10 2026-02-17T08:17:28.541 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 10 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/10 --osd-journal=td/test-erasure-code/10/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:17:28.541 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:17:28.541 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:17:28.541 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:17:28.563 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:28.557+0000 7fc3dcc838c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:17:28.565 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:28.561+0000 7fc3dcc838c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:17:28.566 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:28.561+0000 7fc3dcc838c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:17:28.738 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 10 2026-02-17T08:17:28.738 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:17:28.738 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=10 2026-02-17T08:17:28.738 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:17:28.738 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:17:28.738 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:28.738 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:17:28.738 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:17:28.738 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:28.738 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2026-02-17T08:17:28.930 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:17:29.931 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:17:29.932 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:29.932 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:17:29.933 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:17:29.933 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:29.933 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2026-02-17T08:17:30.102 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:30.097+0000 7fc3dcc838c0 -1 Falling back to public interface 2026-02-17T08:17:30.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:17:31.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:17:31.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:31.127 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:17:31.128 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:17:31.128 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:31.128 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2026-02-17T08:17:31.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:17:32.322 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:17:32.323 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:32.323 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:17:32.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:17:32.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:32.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2026-02-17T08:17:32.513 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:17:33.147 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:33.141+0000 7fc3dcc838c0 -1 osd.10 0 log_to_monitors true 2026-02-17T08:17:33.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:17:33.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:33.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:17:33.515 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:17:33.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:33.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2026-02-17T08:17:33.709 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:17:34.711 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:17:34.711 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:34.711 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:17:34.712 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:17:34.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:34.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.10 up' 2026-02-17T08:17:34.903 INFO:tasks.workunit.client.0.trial059.stdout:osd.10 up in weight 1 up_from 47 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6882/1393169957,v1:127.0.0.1:6883/1393169957] [v2:127.0.0.1:6884/1393169957,v1:127.0.0.1:6885/1393169957] exists,up 3fde5edd-d5ed-4422-8724-7db65c2b3b29 2026-02-17T08:17:34.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:17:34.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:17:34.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:17:34.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:39: run: create_rbd_pool 2026-02-17T08:17:34.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T08:17:35.090 INFO:tasks.workunit.client.0.trial059.stderr:pool 'rbd' does not exist 2026-02-17T08:17:35.098 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2026-02-17T08:17:35.099 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T08:17:35.353 INFO:tasks.workunit.client.0.trial059.stderr:pool 'rbd' already exists 2026-02-17T08:17:35.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:17:36.362 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2026-02-17T08:17:36.636 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:40: run: wait_for_clean 2026-02-17T08:17:36.636 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:17:36.637 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:17:36.637 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:17:36.638 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:17:36.638 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:17:36.638 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:17:36.638 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:17:36.638 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:17:36.638 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:17:36.737 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:17:36.737 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:17:36.737 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:17:36.737 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:17:36.737 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:17:36.738 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:17:36.935 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:17:36.935 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:17:36.935 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:17:36.936 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:17:36.936 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:17:36.936 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:17:36.936 INFO:tasks.workunit.client.0.trial059.stderr:6 2026-02-17T08:17:36.936 INFO:tasks.workunit.client.0.trial059.stderr:7 2026-02-17T08:17:36.936 INFO:tasks.workunit.client.0.trial059.stderr:8 2026-02-17T08:17:36.936 INFO:tasks.workunit.client.0.trial059.stderr:9 2026-02-17T08:17:36.936 INFO:tasks.workunit.client.0.trial059.stderr:10' 2026-02-17T08:17:36.936 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:17:36.936 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:36.936 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:17:37.010 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836501 2026-02-17T08:17:37.010 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836501 2026-02-17T08:17:37.010 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836501' 2026-02-17T08:17:37.010 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:37.010 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:17:37.086 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705683 2026-02-17T08:17:37.086 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705683 2026-02-17T08:17:37.086 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836501 1-38654705683' 2026-02-17T08:17:37.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:37.087 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:17:37.161 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=55834574866 2026-02-17T08:17:37.161 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 55834574866 2026-02-17T08:17:37.161 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836501 1-38654705683 2-55834574866' 2026-02-17T08:17:37.161 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:37.161 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:17:37.237 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=73014444047 2026-02-17T08:17:37.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 73014444047 2026-02-17T08:17:37.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836501 1-38654705683 2-55834574866 3-73014444047' 2026-02-17T08:17:37.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:37.238 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:17:37.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=94489280526 2026-02-17T08:17:37.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 94489280526 2026-02-17T08:17:37.312 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836501 1-38654705683 2-55834574866 3-73014444047 4-94489280526' 2026-02-17T08:17:37.312 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:37.312 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-17T08:17:37.386 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=115964117004 2026-02-17T08:17:37.386 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 115964117004 2026-02-17T08:17:37.386 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836501 1-38654705683 2-55834574866 3-73014444047 4-94489280526 5-115964117004' 2026-02-17T08:17:37.386 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:37.386 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-17T08:17:37.458 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=133143986186 2026-02-17T08:17:37.458 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 133143986186 2026-02-17T08:17:37.459 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836501 1-38654705683 2-55834574866 3-73014444047 4-94489280526 5-115964117004 6-133143986186' 2026-02-17T08:17:37.459 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:37.459 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-17T08:17:37.533 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=150323855369 2026-02-17T08:17:37.534 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 150323855369 2026-02-17T08:17:37.534 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836501 1-38654705683 2-55834574866 3-73014444047 4-94489280526 5-115964117004 6-133143986186 7-150323855369' 2026-02-17T08:17:37.534 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:37.534 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-17T08:17:37.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=167503724551 2026-02-17T08:17:37.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 167503724551 2026-02-17T08:17:37.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836501 1-38654705683 2-55834574866 3-73014444047 4-94489280526 5-115964117004 6-133143986186 7-150323855369 8-167503724551' 2026-02-17T08:17:37.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:37.611 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-17T08:17:37.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=184683593734 2026-02-17T08:17:37.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 184683593734 2026-02-17T08:17:37.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836501 1-38654705683 2-55834574866 3-73014444047 4-94489280526 5-115964117004 6-133143986186 7-150323855369 8-167503724551 9-184683593734' 2026-02-17T08:17:37.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:37.683 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-17T08:17:37.759 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=201863462915 2026-02-17T08:17:37.759 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 201863462915 2026-02-17T08:17:37.760 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836501 1-38654705683 2-55834574866 3-73014444047 4-94489280526 5-115964117004 6-133143986186 7-150323855369 8-167503724551 9-184683593734 10-201863462915' 2026-02-17T08:17:37.760 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:37.760 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836501 2026-02-17T08:17:37.760 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:37.761 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:17:37.762 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836501 2026-02-17T08:17:37.762 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:37.763 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836501 2026-02-17T08:17:37.763 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 21474836501 2026-02-17T08:17:37.764 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836501' 2026-02-17T08:17:37.764 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:17:37.971 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836499 -lt 21474836501 2026-02-17T08:17:37.971 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:17:38.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:17:38.972 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:17:39.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836501 -lt 21474836501 2026-02-17T08:17:39.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:39.166 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705683 2026-02-17T08:17:39.167 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:39.168 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:17:39.169 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705683 2026-02-17T08:17:39.169 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:39.170 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705683 2026-02-17T08:17:39.170 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 38654705683 2026-02-17T08:17:39.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705683' 2026-02-17T08:17:39.171 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:17:39.370 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705683 -lt 38654705683 2026-02-17T08:17:39.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:39.371 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-55834574866 2026-02-17T08:17:39.372 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:39.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:17:39.373 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-55834574866 2026-02-17T08:17:39.373 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:39.374 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=55834574866 2026-02-17T08:17:39.374 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 55834574866 2026-02-17T08:17:39.375 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 55834574866' 2026-02-17T08:17:39.375 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:17:39.574 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 55834574866 -lt 55834574866 2026-02-17T08:17:39.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:39.576 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-73014444047 2026-02-17T08:17:39.576 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:39.577 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:17:39.577 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-73014444047 2026-02-17T08:17:39.577 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:39.578 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=73014444047 2026-02-17T08:17:39.579 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 73014444047 2026-02-17T08:17:39.580 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 73014444047' 2026-02-17T08:17:39.580 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:17:39.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 73014444048 -lt 73014444047 2026-02-17T08:17:39.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:39.779 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-94489280526 2026-02-17T08:17:39.780 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:39.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:17:39.781 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-94489280526 2026-02-17T08:17:39.782 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:39.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=94489280526 2026-02-17T08:17:39.783 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.4 seq 94489280526 2026-02-17T08:17:39.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 94489280526' 2026-02-17T08:17:39.783 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:17:39.986 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 94489280526 -lt 94489280526 2026-02-17T08:17:39.986 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:39.987 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 5-115964117004 2026-02-17T08:17:39.987 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:39.988 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=5 2026-02-17T08:17:39.989 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 5-115964117004 2026-02-17T08:17:39.989 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:39.990 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=115964117004 2026-02-17T08:17:39.991 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.5 seq 115964117004 2026-02-17T08:17:39.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.5 seq 115964117004' 2026-02-17T08:17:39.991 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T08:17:40.196 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 115964117005 -lt 115964117004 2026-02-17T08:17:40.197 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:40.197 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 6-133143986186 2026-02-17T08:17:40.197 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:40.198 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=6 2026-02-17T08:17:40.199 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 6-133143986186 2026-02-17T08:17:40.199 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:40.200 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=133143986186 2026-02-17T08:17:40.200 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.6 seq 133143986186' 2026-02-17T08:17:40.201 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.6 seq 133143986186 2026-02-17T08:17:40.201 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T08:17:40.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 133143986187 -lt 133143986186 2026-02-17T08:17:40.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:40.398 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 7-150323855369 2026-02-17T08:17:40.398 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:40.399 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=7 2026-02-17T08:17:40.400 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 7-150323855369 2026-02-17T08:17:40.400 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:40.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=150323855369 2026-02-17T08:17:40.402 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.7 seq 150323855369 2026-02-17T08:17:40.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.7 seq 150323855369' 2026-02-17T08:17:40.402 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T08:17:40.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 150323855369 -lt 150323855369 2026-02-17T08:17:40.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:40.607 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 8-167503724551 2026-02-17T08:17:40.607 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:40.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=8 2026-02-17T08:17:40.609 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 8-167503724551 2026-02-17T08:17:40.609 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:40.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=167503724551 2026-02-17T08:17:40.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.8 seq 167503724551' 2026-02-17T08:17:40.611 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.8 seq 167503724551 2026-02-17T08:17:40.611 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T08:17:40.816 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 167503724551 -lt 167503724551 2026-02-17T08:17:40.816 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:40.817 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 9-184683593734 2026-02-17T08:17:40.817 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:40.818 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=9 2026-02-17T08:17:40.819 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 9-184683593734 2026-02-17T08:17:40.819 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:40.820 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=184683593734 2026-02-17T08:17:40.820 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.9 seq 184683593734 2026-02-17T08:17:40.820 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.9 seq 184683593734' 2026-02-17T08:17:40.821 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T08:17:41.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 184683593734 -lt 184683593734 2026-02-17T08:17:41.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:41.016 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 10-201863462915 2026-02-17T08:17:41.016 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:41.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=10 2026-02-17T08:17:41.018 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 10-201863462915 2026-02-17T08:17:41.018 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:41.019 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=201863462915 2026-02-17T08:17:41.019 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.10 seq 201863462915 2026-02-17T08:17:41.020 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.10 seq 201863462915' 2026-02-17T08:17:41.020 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-17T08:17:41.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 201863462916 -lt 201863462915 2026-02-17T08:17:41.228 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:17:41.229 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:17:41.229 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:17:41.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 == 0 2026-02-17T08:17:41.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:17:41.493 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:17:41.493 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:17:41.493 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:17:41.493 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:17:41.493 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:17:41.493 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:17:41.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=4 2026-02-17T08:17:41.687 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:17:41.687 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:17:41.687 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:17:41.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 4 = 4 2026-02-17T08:17:41.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:17:41.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:17:41.942 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:42: run: get_asok_path osd.0 2026-02-17T08:17:41.942 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:17:41.942 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:17:41.943 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:17:41.943 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:17:41.943 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:17:41.943 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.41658/ceph-osd.0.asok 2026-02-17T08:17:41.943 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:42: run: CEPH_ARGS= 2026-02-17T08:17:41.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:42: run: ceph --admin-daemon /tmp/ceph-asok.41658/ceph-osd.0.asok log flush 2026-02-17T08:17:42.008 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:17:42.014 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:43: run: grep 'load: jerasure.*lrc' td/test-erasure-code/osd.0.log 2026-02-17T08:17:42.015 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:16:00.817+0000 7f3e8d74d8c0 0 load: jerasure load: lrc 2026-02-17T08:17:42.016 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:44: run: create_erasure_coded_pool ecpool 2026-02-17T08:17:42.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:56: create_erasure_coded_pool: local poolname=ecpool 2026-02-17T08:17:42.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:58: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd 2026-02-17T08:17:42.272 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:60: create_erasure_coded_pool: create_pool ecpool 12 12 erasure myprofile 2026-02-17T08:17:42.272 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create ecpool 12 12 erasure myprofile 2026-02-17T08:17:42.633 INFO:tasks.workunit.client.0.trial059.stderr:pool 'ecpool' already exists 2026-02-17T08:17:42.643 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:17:43.645 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:62: create_erasure_coded_pool: wait_for_clean 2026-02-17T08:17:43.645 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:17:43.645 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:17:43.645 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:17:43.645 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:17:43.646 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:17:43.646 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:17:43.647 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:17:43.647 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:17:43.647 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:17:43.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:17:43.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:17:43.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:17:43.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:17:43.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:17:43.753 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:17:43.952 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:17:43.953 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:17:43.953 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:17:43.953 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:17:43.953 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:17:43.953 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:17:43.953 INFO:tasks.workunit.client.0.trial059.stderr:6 2026-02-17T08:17:43.953 INFO:tasks.workunit.client.0.trial059.stderr:7 2026-02-17T08:17:43.953 INFO:tasks.workunit.client.0.trial059.stderr:8 2026-02-17T08:17:43.953 INFO:tasks.workunit.client.0.trial059.stderr:9 2026-02-17T08:17:43.953 INFO:tasks.workunit.client.0.trial059.stderr:10' 2026-02-17T08:17:43.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:17:43.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:43.953 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:17:44.028 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836504 2026-02-17T08:17:44.029 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836504 2026-02-17T08:17:44.029 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836504' 2026-02-17T08:17:44.029 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:44.029 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:17:44.105 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705687 2026-02-17T08:17:44.105 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705687 2026-02-17T08:17:44.105 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836504 1-38654705687' 2026-02-17T08:17:44.105 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:44.105 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:17:44.182 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=55834574870 2026-02-17T08:17:44.182 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 55834574870 2026-02-17T08:17:44.182 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836504 1-38654705687 2-55834574870' 2026-02-17T08:17:44.182 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:44.182 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:17:44.255 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=73014444051 2026-02-17T08:17:44.255 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 73014444051 2026-02-17T08:17:44.255 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836504 1-38654705687 2-55834574870 3-73014444051' 2026-02-17T08:17:44.255 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:44.256 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:17:44.330 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=94489280529 2026-02-17T08:17:44.330 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 94489280529 2026-02-17T08:17:44.330 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836504 1-38654705687 2-55834574870 3-73014444051 4-94489280529' 2026-02-17T08:17:44.330 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:44.331 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-17T08:17:44.405 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=115964117007 2026-02-17T08:17:44.405 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 115964117007 2026-02-17T08:17:44.405 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836504 1-38654705687 2-55834574870 3-73014444051 4-94489280529 5-115964117007' 2026-02-17T08:17:44.405 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:44.406 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-17T08:17:44.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=133143986190 2026-02-17T08:17:44.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 133143986190 2026-02-17T08:17:44.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836504 1-38654705687 2-55834574870 3-73014444051 4-94489280529 5-115964117007 6-133143986190' 2026-02-17T08:17:44.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:44.483 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-17T08:17:44.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=150323855372 2026-02-17T08:17:44.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 150323855372 2026-02-17T08:17:44.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836504 1-38654705687 2-55834574870 3-73014444051 4-94489280529 5-115964117007 6-133143986190 7-150323855372' 2026-02-17T08:17:44.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:44.558 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-17T08:17:44.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=167503724554 2026-02-17T08:17:44.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 167503724554 2026-02-17T08:17:44.634 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836504 1-38654705687 2-55834574870 3-73014444051 4-94489280529 5-115964117007 6-133143986190 7-150323855372 8-167503724554' 2026-02-17T08:17:44.634 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:44.634 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-17T08:17:44.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=184683593737 2026-02-17T08:17:44.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 184683593737 2026-02-17T08:17:44.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836504 1-38654705687 2-55834574870 3-73014444051 4-94489280529 5-115964117007 6-133143986190 7-150323855372 8-167503724554 9-184683593737' 2026-02-17T08:17:44.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:44.707 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-17T08:17:44.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=201863462919 2026-02-17T08:17:44.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 201863462919 2026-02-17T08:17:44.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836504 1-38654705687 2-55834574870 3-73014444051 4-94489280529 5-115964117007 6-133143986190 7-150323855372 8-167503724554 9-184683593737 10-201863462919' 2026-02-17T08:17:44.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:44.784 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836504 2026-02-17T08:17:44.784 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:44.784 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:17:44.785 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836504 2026-02-17T08:17:44.785 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:44.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836504 2026-02-17T08:17:44.787 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 21474836504 2026-02-17T08:17:44.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836504' 2026-02-17T08:17:44.788 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:17:44.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836502 -lt 21474836504 2026-02-17T08:17:44.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:17:45.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:17:45.983 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:17:46.181 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836505 -lt 21474836504 2026-02-17T08:17:46.181 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:46.182 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705687 2026-02-17T08:17:46.182 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:46.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:17:46.184 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705687 2026-02-17T08:17:46.184 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:46.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705687 2026-02-17T08:17:46.185 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 38654705687 2026-02-17T08:17:46.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705687' 2026-02-17T08:17:46.186 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:17:46.381 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705687 -lt 38654705687 2026-02-17T08:17:46.381 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:46.382 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-55834574870 2026-02-17T08:17:46.382 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:46.383 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:17:46.384 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-55834574870 2026-02-17T08:17:46.384 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:46.385 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=55834574870 2026-02-17T08:17:46.385 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 55834574870 2026-02-17T08:17:46.386 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 55834574870' 2026-02-17T08:17:46.386 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:17:46.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 55834574870 -lt 55834574870 2026-02-17T08:17:46.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:46.587 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-73014444051 2026-02-17T08:17:46.587 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:46.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:17:46.589 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-73014444051 2026-02-17T08:17:46.589 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:46.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=73014444051 2026-02-17T08:17:46.590 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 73014444051 2026-02-17T08:17:46.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 73014444051' 2026-02-17T08:17:46.590 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:17:46.792 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 73014444051 -lt 73014444051 2026-02-17T08:17:46.792 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:46.793 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-94489280529 2026-02-17T08:17:46.793 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:46.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:17:46.795 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-94489280529 2026-02-17T08:17:46.795 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:46.797 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=94489280529 2026-02-17T08:17:46.797 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.4 seq 94489280529 2026-02-17T08:17:46.797 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 94489280529' 2026-02-17T08:17:46.798 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:17:47.001 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 94489280530 -lt 94489280529 2026-02-17T08:17:47.001 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:47.002 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 5-115964117007 2026-02-17T08:17:47.002 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:47.003 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=5 2026-02-17T08:17:47.004 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 5-115964117007 2026-02-17T08:17:47.004 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:47.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=115964117007 2026-02-17T08:17:47.006 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.5 seq 115964117007 2026-02-17T08:17:47.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.5 seq 115964117007' 2026-02-17T08:17:47.006 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T08:17:47.209 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 115964117008 -lt 115964117007 2026-02-17T08:17:47.210 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:47.210 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 6-133143986190 2026-02-17T08:17:47.210 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:47.211 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=6 2026-02-17T08:17:47.212 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 6-133143986190 2026-02-17T08:17:47.212 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:47.214 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=133143986190 2026-02-17T08:17:47.214 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.6 seq 133143986190 2026-02-17T08:17:47.214 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.6 seq 133143986190' 2026-02-17T08:17:47.214 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T08:17:47.418 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 133143986190 -lt 133143986190 2026-02-17T08:17:47.418 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:47.418 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 7-150323855372 2026-02-17T08:17:47.419 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:47.420 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=7 2026-02-17T08:17:47.421 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 7-150323855372 2026-02-17T08:17:47.421 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:47.422 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=150323855372 2026-02-17T08:17:47.422 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.7 seq 150323855372 2026-02-17T08:17:47.423 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.7 seq 150323855372' 2026-02-17T08:17:47.423 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T08:17:47.626 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 150323855372 -lt 150323855372 2026-02-17T08:17:47.626 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:47.627 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 8-167503724554 2026-02-17T08:17:47.627 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:47.628 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=8 2026-02-17T08:17:47.629 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 8-167503724554 2026-02-17T08:17:47.629 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:47.630 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=167503724554 2026-02-17T08:17:47.631 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.8 seq 167503724554 2026-02-17T08:17:47.631 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.8 seq 167503724554' 2026-02-17T08:17:47.631 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T08:17:47.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 167503724554 -lt 167503724554 2026-02-17T08:17:47.841 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:47.841 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 9-184683593737 2026-02-17T08:17:47.841 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:47.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=9 2026-02-17T08:17:47.843 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 9-184683593737 2026-02-17T08:17:47.843 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:47.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=184683593737 2026-02-17T08:17:47.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.9 seq 184683593737' 2026-02-17T08:17:47.845 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.9 seq 184683593737 2026-02-17T08:17:47.846 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T08:17:48.041 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 184683593738 -lt 184683593737 2026-02-17T08:17:48.041 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:48.042 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 10-201863462919 2026-02-17T08:17:48.042 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:48.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=10 2026-02-17T08:17:48.044 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 10-201863462919 2026-02-17T08:17:48.044 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:48.045 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=201863462919 2026-02-17T08:17:48.045 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.10 seq 201863462919' 2026-02-17T08:17:48.045 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.10 seq 201863462919 2026-02-17T08:17:48.046 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-17T08:17:48.249 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 201863462919 -lt 201863462919 2026-02-17T08:17:48.250 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:17:48.250 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:17:48.251 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:17:48.510 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 == 0 2026-02-17T08:17:48.510 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:17:48.510 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:17:48.510 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:17:48.511 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:17:48.511 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:17:48.511 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:17:48.511 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:17:48.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=16 2026-02-17T08:17:48.707 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:17:48.707 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:17:48.708 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:17:48.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 16 = 16 2026-02-17T08:17:48.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:17:48.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:17:48.972 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:46: run: set 2026-02-17T08:17:48.973 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:46: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T08:17:48.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:46: run: local 'funcs=TEST_alignment_constraints 2026-02-17T08:17:48.974 INFO:tasks.workunit.client.0.trial059.stderr:TEST_chunk_mapping 2026-02-17T08:17:48.974 INFO:tasks.workunit.client.0.trial059.stderr:TEST_rados_put_get_isa 2026-02-17T08:17:48.974 INFO:tasks.workunit.client.0.trial059.stderr:TEST_rados_put_get_jerasure 2026-02-17T08:17:48.974 INFO:tasks.workunit.client.0.trial059.stderr:TEST_rados_put_get_lrc_advanced 2026-02-17T08:17:48.975 INFO:tasks.workunit.client.0.trial059.stderr:TEST_rados_put_get_lrc_kml 2026-02-17T08:17:48.975 INFO:tasks.workunit.client.0.trial059.stderr:TEST_rados_put_get_shec' 2026-02-17T08:17:48.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:47: run: for func in $funcs 2026-02-17T08:17:48.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:48: run: TEST_alignment_constraints td/test-erasure-code 2026-02-17T08:17:48.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:253: TEST_alignment_constraints: local payload=ABC 2026-02-17T08:17:48.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:254: TEST_alignment_constraints: echo ABC 2026-02-17T08:17:48.975 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:260: TEST_alignment_constraints: ceph-conf --show-config-value osd_pool_erasure_code_stripe_unit 2026-02-17T08:17:48.990 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:260: TEST_alignment_constraints: local stripe_unit=4096 2026-02-17T08:17:48.991 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:261: TEST_alignment_constraints: ceph osd erasure-code-profile get myprofile 2026-02-17T08:17:48.992 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:261: TEST_alignment_constraints: grep k= 2026-02-17T08:17:49.197 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:261: TEST_alignment_constraints: eval local k=2 2026-02-17T08:17:49.197 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:261: TEST_alignment_constraints: local k=2 2026-02-17T08:17:49.197 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:262: TEST_alignment_constraints: local block_size=8191 2026-02-17T08:17:49.197 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:263: TEST_alignment_constraints: dd if=/dev/zero of=td/test-erasure-code/ORIGINAL bs=8191 count=2 2026-02-17T08:17:49.198 INFO:tasks.workunit.client.0.trial059.stderr:2+0 records in 2026-02-17T08:17:49.198 INFO:tasks.workunit.client.0.trial059.stderr:2+0 records out 2026-02-17T08:17:49.198 INFO:tasks.workunit.client.0.trial059.stderr:16382 bytes (16 kB, 16 KiB) copied, 8.8887e-05 s, 184 MB/s 2026-02-17T08:17:49.198 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:264: TEST_alignment_constraints: rados --block-size=8191 --pool ecpool put UNALIGNED td/test-erasure-code/ORIGINAL 2026-02-17T08:17:49.215 INFO:tasks.workunit.client.0.trial059.stderr:INFO: op_size has been rounded to 8192 2026-02-17T08:17:49.219 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:266: TEST_alignment_constraints: rm td/test-erasure-code/ORIGINAL 2026-02-17T08:17:49.221 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:47: run: for func in $funcs 2026-02-17T08:17:49.221 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:48: run: TEST_chunk_mapping td/test-erasure-code 2026-02-17T08:17:49.222 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:304: TEST_chunk_mapping: local dir=td/test-erasure-code 2026-02-17T08:17:49.222 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:311: TEST_chunk_mapping: verify_chunk_mapping td/test-erasure-code ecpool 0 1 2026-02-17T08:17:49.222 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:281: verify_chunk_mapping: local dir=td/test-erasure-code 2026-02-17T08:17:49.222 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:282: verify_chunk_mapping: local poolname=ecpool 2026-02-17T08:17:49.222 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:283: verify_chunk_mapping: local first=0 2026-02-17T08:17:49.222 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:284: verify_chunk_mapping: local second=1 2026-02-17T08:17:49.222 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: chunk_size 2026-02-17T08:17:49.222 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:270: chunk_size: ceph-conf --show-config-value osd_pool_erasure_code_stripe_unit 2026-02-17T08:17:49.231 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:270: chunk_size: echo 4096 2026-02-17T08:17:49.232 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: printf '%*s' 4096 FIRSTecpool 2026-02-17T08:17:49.232 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: chunk_size 2026-02-17T08:17:49.232 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:270: chunk_size: ceph-conf --show-config-value osd_pool_erasure_code_stripe_unit 2026-02-17T08:17:49.242 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:270: chunk_size: echo 4096 2026-02-17T08:17:49.243 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: printf '%*s' 4096 SECONDecpool 2026-02-17T08:17:49.243 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: local 'payload= FIRSTecpool SECONDecpool' 2026-02-17T08:17:49.243 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:287: verify_chunk_mapping: echo -n ' FIRSTecpool SECONDecpool' 2026-02-17T08:17:49.244 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:289: verify_chunk_mapping: rados --pool ecpool put SOMETHINGecpool td/test-erasure-code/ORIGINAL 2026-02-17T08:17:49.269 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:290: verify_chunk_mapping: rados --pool ecpool get SOMETHINGecpool td/test-erasure-code/COPY 2026-02-17T08:17:49.296 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:291: verify_chunk_mapping: get_osds ecpool SOMETHINGecpool 2026-02-17T08:17:49.297 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=ecpool 2026-02-17T08:17:49.297 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=SOMETHINGecpool 2026-02-17T08:17:49.297 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map ecpool SOMETHINGecpool 2026-02-17T08:17:49.298 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:17:49.495 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:17:49.495 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:17:49.495 INFO:tasks.workunit.client.0.trial059.stderr:9 2026-02-17T08:17:49.495 INFO:tasks.workunit.client.0.trial059.stderr:0' 2026-02-17T08:17:49.495 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 5 9 0 2026-02-17T08:17:49.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:291: verify_chunk_mapping: osds=('3' '5' '9' '0') 2026-02-17T08:17:49.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:291: verify_chunk_mapping: local -a osds 2026-02-17T08:17:49.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i = 0 )) 2026-02-17T08:17:49.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 4 )) 2026-02-17T08:17:49.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:293: verify_chunk_mapping: ceph daemon osd.3 flush_journal 2026-02-17T08:17:49.559 INFO:tasks.workunit.client.0.trial059.stderr:Can't get admin socket path: unable to get conf option admin_socket for osd: b"error parsing 'osd': expected string of the form TYPE.ID, valid types are: auth, mon, osd, mds, mgr, client\n" 2026-02-17T08:17:49.561 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i++ )) 2026-02-17T08:17:49.561 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 4 )) 2026-02-17T08:17:49.561 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:293: verify_chunk_mapping: ceph daemon osd.5 flush_journal 2026-02-17T08:17:49.624 INFO:tasks.workunit.client.0.trial059.stderr:Can't get admin socket path: unable to get conf option admin_socket for osd: b"error parsing 'osd': expected string of the form TYPE.ID, valid types are: auth, mon, osd, mds, mgr, client\n" 2026-02-17T08:17:49.626 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i++ )) 2026-02-17T08:17:49.626 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 4 )) 2026-02-17T08:17:49.626 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:293: verify_chunk_mapping: ceph daemon osd.9 flush_journal 2026-02-17T08:17:49.699 INFO:tasks.workunit.client.0.trial059.stderr:Can't get admin socket path: unable to get conf option admin_socket for osd: b"error parsing 'osd': expected string of the form TYPE.ID, valid types are: auth, mon, osd, mds, mgr, client\n" 2026-02-17T08:17:49.701 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i++ )) 2026-02-17T08:17:49.701 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 4 )) 2026-02-17T08:17:49.701 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:293: verify_chunk_mapping: ceph daemon osd.0 flush_journal 2026-02-17T08:17:49.768 INFO:tasks.workunit.client.0.trial059.stderr:Can't get admin socket path: unable to get conf option admin_socket for osd: b"error parsing 'osd': expected string of the form TYPE.ID, valid types are: auth, mon, osd, mds, mgr, client\n" 2026-02-17T08:17:49.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i++ )) 2026-02-17T08:17:49.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 4 )) 2026-02-17T08:17:49.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:295: verify_chunk_mapping: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-17T08:17:49.771 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:296: verify_chunk_mapping: rm td/test-erasure-code/COPY 2026-02-17T08:17:49.773 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:298: verify_chunk_mapping: get_osds ecpool SOMETHINGecpool 2026-02-17T08:17:49.773 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=ecpool 2026-02-17T08:17:49.773 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=SOMETHINGecpool 2026-02-17T08:17:49.774 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map ecpool SOMETHINGecpool 2026-02-17T08:17:49.774 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:17:49.973 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:17:49.973 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:17:49.973 INFO:tasks.workunit.client.0.trial059.stderr:9 2026-02-17T08:17:49.973 INFO:tasks.workunit.client.0.trial059.stderr:0' 2026-02-17T08:17:49.973 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 5 9 0 2026-02-17T08:17:49.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:298: verify_chunk_mapping: osds=('3' '5' '9' '0') 2026-02-17T08:17:49.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:298: verify_chunk_mapping: local -a osds 2026-02-17T08:17:49.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:299: verify_chunk_mapping: objectstore_tool td/test-erasure-code 3 SOMETHINGecpool get-bytes 2026-02-17T08:17:49.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1297: objectstore_tool: local dir=td/test-erasure-code 2026-02-17T08:17:49.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: objectstore_tool: shift 2026-02-17T08:17:49.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1299: objectstore_tool: local id=3 2026-02-17T08:17:49.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: objectstore_tool: shift 2026-02-17T08:17:49.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: _objectstore_tool_nowait td/test-erasure-code 3 SOMETHINGecpool get-bytes 2026-02-17T08:17:49.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/test-erasure-code 2026-02-17T08:17:49.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2026-02-17T08:17:49.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=3 2026-02-17T08:17:49.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2026-02-17T08:17:49.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/test-erasure-code TERM osd.3 2026-02-17T08:17:49.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:299: verify_chunk_mapping: grep --quiet FIRSTecpool 2026-02-17T08:17:49.974 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:17:49.974 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:17:49.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:17:49.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:17:49.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:17:51.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:17:51.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-code 3 SOMETHINGecpool get-bytes 2026-02-17T08:17:51.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/test-erasure-code 2026-02-17T08:17:51.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T08:17:51.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=3 2026-02-17T08:17:51.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T08:17:51.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/test-erasure-code/3 2026-02-17T08:17:51.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-code/3 SOMETHINGecpool get-bytes 2026-02-17T08:17:52.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: _objectstore_tool_nowait: activate_osd td/test-erasure-code 3 2026-02-17T08:17:52.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-code 2026-02-17T08:17:52.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:17:52.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=3 2026-02-17T08:17:52.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:17:52.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-code/3 2026-02-17T08:17:52.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-17T08:17:52.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:17:52.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:17:52.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:17:52.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-code/3' 2026-02-17T08:17:52.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-code/3/journal' 2026-02-17T08:17:52.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:17:52.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:17:52.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-17T08:17:52.149 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:17:52.149 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:17:52.149 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:17:52.149 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:17:52.149 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:17:52.149 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:17:52.149 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:17:52.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:17:52.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:17:52.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-17T08:17:52.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-17T08:17:52.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:17:52.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:17:52.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:17:52.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:17:52.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:17:52.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:17:52.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-code/3 2026-02-17T08:17:52.151 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.3 2026-02-17T08:17:52.152 INFO:tasks.workunit.client.0.trial059.stderr:start osd.3 2026-02-17T08:17:52.152 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 3 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/3 --osd-journal=td/test-erasure-code/3/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:17:52.152 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-code/3/whoami 2026-02-17T08:17:52.152 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 3 = 3 ']' 2026-02-17T08:17:52.152 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:17:52.152 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:17:52.152 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:17:52.170 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:52.165+0000 7f39a84f38c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:17:52.171 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:52.165+0000 7f39a84f38c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:17:52.172 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:52.169+0000 7f39a84f38c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:17:52.345 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 3 2026-02-17T08:17:52.345 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:17:52.345 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T08:17:52.345 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:17:52.345 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:17:52.345 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:52.345 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:17:52.346 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:17:52.346 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:52.346 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:17:52.542 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:17:53.461 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:53.457+0000 7f39a84f38c0 -1 Falling back to public interface 2026-02-17T08:17:53.543 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:17:53.543 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:53.543 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:17:53.544 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:17:53.544 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:53.544 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:17:53.739 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:17:54.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:17:54.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:54.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:17:54.741 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:17:54.742 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:54.742 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:17:54.937 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:17:55.939 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:17:55.939 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:55.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:17:55.940 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:17:55.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:55.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:17:56.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:17:56.481 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:17:56.477+0000 7f39a84f38c0 -1 osd.3 65 log_to_monitors true 2026-02-17T08:17:57.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:17:57.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:17:57.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:17:57.142 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:17:57.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:17:57.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:17:57.338 INFO:tasks.workunit.client.0.trial059.stderr:osd.3 up in weight 1 up_from 69 up_thru 69 down_at 66 last_clean_interval [17,65) [v2:127.0.0.1:6826/1933385194,v1:127.0.0.1:6827/1933385194] [v2:127.0.0.1:6828/1933385194,v1:127.0.0.1:6829/1933385194] exists,up 5df223e2-4756-4df5-80a6-f58675fbdacb 2026-02-17T08:17:57.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:17:57.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:17:57.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:17:57.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: objectstore_tool: wait_for_clean 2026-02-17T08:17:57.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:17:57.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:17:57.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:17:57.339 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:17:57.339 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:17:57.339 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:17:57.339 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:17:57.339 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:17:57.339 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:17:57.439 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:17:57.439 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:17:57.439 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:17:57.440 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:17:57.440 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:17:57.440 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:17:57.634 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:17:57.634 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:17:57.634 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:17:57.634 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:17:57.634 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:17:57.634 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:17:57.634 INFO:tasks.workunit.client.0.trial059.stderr:6 2026-02-17T08:17:57.634 INFO:tasks.workunit.client.0.trial059.stderr:7 2026-02-17T08:17:57.634 INFO:tasks.workunit.client.0.trial059.stderr:8 2026-02-17T08:17:57.634 INFO:tasks.workunit.client.0.trial059.stderr:9 2026-02-17T08:17:57.634 INFO:tasks.workunit.client.0.trial059.stderr:10' 2026-02-17T08:17:57.634 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:17:57.634 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:57.634 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:17:57.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836509 2026-02-17T08:17:57.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836509 2026-02-17T08:17:57.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836509' 2026-02-17T08:17:57.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:57.713 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:17:57.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705691 2026-02-17T08:17:57.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705691 2026-02-17T08:17:57.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836509 1-38654705691' 2026-02-17T08:17:57.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:57.786 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:17:57.862 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=55834574874 2026-02-17T08:17:57.862 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 55834574874 2026-02-17T08:17:57.862 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836509 1-38654705691 2-55834574874' 2026-02-17T08:17:57.862 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:57.862 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:17:57.937 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=296352743427 2026-02-17T08:17:57.937 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 296352743427 2026-02-17T08:17:57.937 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836509 1-38654705691 2-55834574874 3-296352743427' 2026-02-17T08:17:57.937 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:57.938 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:17:58.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=94489280534 2026-02-17T08:17:58.016 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 94489280534 2026-02-17T08:17:58.016 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836509 1-38654705691 2-55834574874 3-296352743427 4-94489280534' 2026-02-17T08:17:58.016 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:58.016 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-17T08:17:58.091 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=115964117012 2026-02-17T08:17:58.092 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 115964117012 2026-02-17T08:17:58.092 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836509 1-38654705691 2-55834574874 3-296352743427 4-94489280534 5-115964117012' 2026-02-17T08:17:58.092 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:58.092 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-17T08:17:58.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=133143986194 2026-02-17T08:17:58.167 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 133143986194 2026-02-17T08:17:58.167 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836509 1-38654705691 2-55834574874 3-296352743427 4-94489280534 5-115964117012 6-133143986194' 2026-02-17T08:17:58.167 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:58.167 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-17T08:17:58.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=150323855377 2026-02-17T08:17:58.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 150323855377 2026-02-17T08:17:58.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836509 1-38654705691 2-55834574874 3-296352743427 4-94489280534 5-115964117012 6-133143986194 7-150323855377' 2026-02-17T08:17:58.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:58.240 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-17T08:17:58.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=167503724559 2026-02-17T08:17:58.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 167503724559 2026-02-17T08:17:58.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836509 1-38654705691 2-55834574874 3-296352743427 4-94489280534 5-115964117012 6-133143986194 7-150323855377 8-167503724559' 2026-02-17T08:17:58.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:58.315 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-17T08:17:58.388 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=184683593742 2026-02-17T08:17:58.388 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 184683593742 2026-02-17T08:17:58.389 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836509 1-38654705691 2-55834574874 3-296352743427 4-94489280534 5-115964117012 6-133143986194 7-150323855377 8-167503724559 9-184683593742' 2026-02-17T08:17:58.389 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:17:58.389 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-17T08:17:58.466 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=201863462923 2026-02-17T08:17:58.466 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 201863462923 2026-02-17T08:17:58.467 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836509 1-38654705691 2-55834574874 3-296352743427 4-94489280534 5-115964117012 6-133143986194 7-150323855377 8-167503724559 9-184683593742 10-201863462923' 2026-02-17T08:17:58.467 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:58.467 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836509 2026-02-17T08:17:58.467 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:58.468 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:17:58.468 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836509 2026-02-17T08:17:58.468 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:58.470 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836509 2026-02-17T08:17:58.470 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836509' 2026-02-17T08:17:58.470 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.0 seq 21474836509 2026-02-17T08:17:58.470 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:17:58.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836509 -lt 21474836509 2026-02-17T08:17:58.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:58.675 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705691 2026-02-17T08:17:58.675 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:58.676 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:17:58.677 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705691 2026-02-17T08:17:58.677 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:58.678 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705691 2026-02-17T08:17:58.678 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705691' 2026-02-17T08:17:58.678 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.1 seq 38654705691 2026-02-17T08:17:58.678 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:17:58.878 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705691 -lt 38654705691 2026-02-17T08:17:58.878 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:58.878 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-55834574874 2026-02-17T08:17:58.879 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:58.880 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:17:58.881 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-55834574874 2026-02-17T08:17:58.881 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:58.882 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=55834574874 2026-02-17T08:17:58.882 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 55834574874' 2026-02-17T08:17:58.882 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.2 seq 55834574874 2026-02-17T08:17:58.883 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:17:59.090 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 55834574874 -lt 55834574874 2026-02-17T08:17:59.090 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:59.090 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-296352743427 2026-02-17T08:17:59.090 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:59.093 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:17:59.093 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-296352743427 2026-02-17T08:17:59.093 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:59.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=296352743427 2026-02-17T08:17:59.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 296352743427' 2026-02-17T08:17:59.095 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.3 seq 296352743427 2026-02-17T08:17:59.095 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:17:59.297 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 296352743427 -lt 296352743427 2026-02-17T08:17:59.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:17:59.298 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-94489280534 2026-02-17T08:17:59.298 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:17:59.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:17:59.299 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-94489280534 2026-02-17T08:17:59.300 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:17:59.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=94489280534 2026-02-17T08:17:59.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 94489280534' 2026-02-17T08:17:59.301 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.4 seq 94489280534 2026-02-17T08:17:59.301 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:17:59.501 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 94489280532 -lt 94489280534 2026-02-17T08:17:59.501 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:18:00.502 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:18:00.502 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:18:00.695 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 94489280534 -lt 94489280534 2026-02-17T08:18:00.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:00.696 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 5-115964117012 2026-02-17T08:18:00.696 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:00.697 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=5 2026-02-17T08:18:00.698 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 5-115964117012 2026-02-17T08:18:00.698 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:00.699 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=115964117012 2026-02-17T08:18:00.699 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.5 seq 115964117012' 2026-02-17T08:18:00.699 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.5 seq 115964117012 2026-02-17T08:18:00.700 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T08:18:00.897 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 115964117013 -lt 115964117012 2026-02-17T08:18:00.897 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:00.897 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 6-133143986194 2026-02-17T08:18:00.898 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:00.898 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=6 2026-02-17T08:18:00.899 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 6-133143986194 2026-02-17T08:18:00.899 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:00.900 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=133143986194 2026-02-17T08:18:00.900 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.6 seq 133143986194' 2026-02-17T08:18:00.900 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.6 seq 133143986194 2026-02-17T08:18:00.901 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T08:18:01.104 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 133143986195 -lt 133143986194 2026-02-17T08:18:01.104 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:01.105 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 7-150323855377 2026-02-17T08:18:01.105 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:01.105 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=7 2026-02-17T08:18:01.106 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 7-150323855377 2026-02-17T08:18:01.106 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:01.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=150323855377 2026-02-17T08:18:01.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.7 seq 150323855377' 2026-02-17T08:18:01.108 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.7 seq 150323855377 2026-02-17T08:18:01.108 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T08:18:01.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 150323855377 -lt 150323855377 2026-02-17T08:18:01.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:01.315 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 8-167503724559 2026-02-17T08:18:01.315 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:01.315 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=8 2026-02-17T08:18:01.316 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 8-167503724559 2026-02-17T08:18:01.316 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:01.317 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=167503724559 2026-02-17T08:18:01.317 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.8 seq 167503724559' 2026-02-17T08:18:01.317 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.8 seq 167503724559 2026-02-17T08:18:01.318 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T08:18:01.527 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 167503724559 -lt 167503724559 2026-02-17T08:18:01.527 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:01.527 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 9-184683593742 2026-02-17T08:18:01.527 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:01.529 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=9 2026-02-17T08:18:01.529 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 9-184683593742 2026-02-17T08:18:01.529 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:01.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=184683593742 2026-02-17T08:18:01.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.9 seq 184683593742' 2026-02-17T08:18:01.531 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.9 seq 184683593742 2026-02-17T08:18:01.531 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T08:18:01.732 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 184683593742 -lt 184683593742 2026-02-17T08:18:01.732 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:01.732 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 10-201863462923 2026-02-17T08:18:01.732 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:01.733 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=10 2026-02-17T08:18:01.734 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 10-201863462923 2026-02-17T08:18:01.734 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:01.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=201863462923 2026-02-17T08:18:01.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.10 seq 201863462923' 2026-02-17T08:18:01.735 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.10 seq 201863462923 2026-02-17T08:18:01.736 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-17T08:18:01.934 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 201863462924 -lt 201863462923 2026-02-17T08:18:01.935 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:18:01.935 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:18:01.935 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:18:02.197 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 == 0 2026-02-17T08:18:02.197 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:18:02.197 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:18:02.197 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:18:02.197 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:18:02.197 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:18:02.197 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:18:02.197 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:18:02.394 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=16 2026-02-17T08:18:02.394 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:18:02.394 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:18:02.395 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:18:02.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 16 = 16 2026-02-17T08:18:02.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:18:02.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:18:02.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:300: verify_chunk_mapping: objectstore_tool td/test-erasure-code 5 SOMETHINGecpool get-bytes 2026-02-17T08:18:02.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1297: objectstore_tool: local dir=td/test-erasure-code 2026-02-17T08:18:02.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: objectstore_tool: shift 2026-02-17T08:18:02.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1299: objectstore_tool: local id=5 2026-02-17T08:18:02.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: objectstore_tool: shift 2026-02-17T08:18:02.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: _objectstore_tool_nowait td/test-erasure-code 5 SOMETHINGecpool get-bytes 2026-02-17T08:18:02.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/test-erasure-code 2026-02-17T08:18:02.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2026-02-17T08:18:02.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=5 2026-02-17T08:18:02.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2026-02-17T08:18:02.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/test-erasure-code TERM osd.5 2026-02-17T08:18:02.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:300: verify_chunk_mapping: grep --quiet SECONDecpool 2026-02-17T08:18:02.662 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:18:02.662 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:18:02.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:18:02.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:18:02.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:18:03.969 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:18:03.969 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-code 5 SOMETHINGecpool get-bytes 2026-02-17T08:18:03.969 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/test-erasure-code 2026-02-17T08:18:03.969 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T08:18:03.969 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=5 2026-02-17T08:18:03.970 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T08:18:03.970 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/test-erasure-code/5 2026-02-17T08:18:03.970 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-code/5 SOMETHINGecpool get-bytes 2026-02-17T08:18:04.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: _objectstore_tool_nowait: activate_osd td/test-erasure-code 5 2026-02-17T08:18:04.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-code 2026-02-17T08:18:04.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:18:04.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=5 2026-02-17T08:18:04.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:18:04.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-code/5 2026-02-17T08:18:04.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-17T08:18:04.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:18:04.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:18:04.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:18:04.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-code/5' 2026-02-17T08:18:04.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-code/5/journal' 2026-02-17T08:18:04.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:18:04.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:18:04.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-17T08:18:04.821 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:18:04.822 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:18:04.822 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:18:04.822 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:18:04.822 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:18:04.822 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:18:04.822 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:18:04.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:18:04.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:18:04.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-17T08:18:04.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-17T08:18:04.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:18:04.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:18:04.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:18:04.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:18:04.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:18:04.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:18:04.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-code/5 2026-02-17T08:18:04.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.5 2026-02-17T08:18:04.823 INFO:tasks.workunit.client.0.trial059.stderr:start osd.5 2026-02-17T08:18:04.824 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 5 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/5 --osd-journal=td/test-erasure-code/5/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:18:04.824 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-code/5/whoami 2026-02-17T08:18:04.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 5 = 5 ']' 2026-02-17T08:18:04.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:18:04.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:18:04.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:18:04.842 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:18:04.837+0000 7fcc38c5d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:18:04.844 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:18:04.837+0000 7fcc38c5d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:18:04.845 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:18:04.841+0000 7fcc38c5d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:18:05.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 5 2026-02-17T08:18:05.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:18:05.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=5 2026-02-17T08:18:05.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:18:05.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:18:05.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:18:05.024 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:18:05.024 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:18:05.024 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:18:05.024 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:18:05.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:18:06.066 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:18:06.061+0000 7fcc38c5d8c0 -1 Falling back to public interface 2026-02-17T08:18:06.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:18:06.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:18:06.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:18:06.220 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:18:06.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:18:06.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:18:06.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:18:07.416 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:18:07.416 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:18:07.416 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:18:07.416 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:18:07.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:18:07.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:18:07.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:18:08.612 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:18:08.613 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:18:08.613 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:18:08.613 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:18:08.613 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:18:08.613 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:18:08.803 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:18:09.102 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:18:09.097+0000 7fcc38c5d8c0 -1 osd.5 71 log_to_monitors true 2026-02-17T08:18:09.805 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:18:09.805 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:18:09.805 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:18:09.806 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:18:09.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:18:09.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:18:09.999 INFO:tasks.workunit.client.0.trial059.stderr:osd.5 up in weight 1 up_from 76 up_thru 76 down_at 72 last_clean_interval [27,71) [v2:127.0.0.1:6842/2300219341,v1:127.0.0.1:6843/2300219341] [v2:127.0.0.1:6844/2300219341,v1:127.0.0.1:6845/2300219341] exists,up bf740c13-17d8-43b9-9ecf-f1a55a11692d 2026-02-17T08:18:10.000 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:18:10.000 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:18:10.000 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:18:10.000 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: objectstore_tool: wait_for_clean 2026-02-17T08:18:10.000 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:18:10.000 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:18:10.001 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:18:10.001 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:18:10.002 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:18:10.002 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:18:10.002 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:18:10.002 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:18:10.002 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:18:10.104 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:18:10.104 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:18:10.104 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:18:10.104 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:18:10.104 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:18:10.104 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:18:10.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:18:10.299 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:18:10.299 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:18:10.299 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:18:10.299 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:18:10.299 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:18:10.299 INFO:tasks.workunit.client.0.trial059.stderr:6 2026-02-17T08:18:10.299 INFO:tasks.workunit.client.0.trial059.stderr:7 2026-02-17T08:18:10.299 INFO:tasks.workunit.client.0.trial059.stderr:8 2026-02-17T08:18:10.299 INFO:tasks.workunit.client.0.trial059.stderr:9 2026-02-17T08:18:10.299 INFO:tasks.workunit.client.0.trial059.stderr:10' 2026-02-17T08:18:10.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:18:10.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:10.300 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:18:10.373 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836514 2026-02-17T08:18:10.373 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836514 2026-02-17T08:18:10.373 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836514' 2026-02-17T08:18:10.373 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:10.373 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:18:10.448 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705696 2026-02-17T08:18:10.448 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705696 2026-02-17T08:18:10.448 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836514 1-38654705696' 2026-02-17T08:18:10.448 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:10.449 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:18:10.524 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=55834574879 2026-02-17T08:18:10.524 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 55834574879 2026-02-17T08:18:10.524 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836514 1-38654705696 2-55834574879' 2026-02-17T08:18:10.525 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:10.525 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:18:10.601 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=296352743431 2026-02-17T08:18:10.601 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 296352743431 2026-02-17T08:18:10.601 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836514 1-38654705696 2-55834574879 3-296352743431' 2026-02-17T08:18:10.601 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:10.601 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:18:10.676 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=94489280539 2026-02-17T08:18:10.676 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 94489280539 2026-02-17T08:18:10.676 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836514 1-38654705696 2-55834574879 3-296352743431 4-94489280539' 2026-02-17T08:18:10.676 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:10.676 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-17T08:18:10.751 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=326417514499 2026-02-17T08:18:10.751 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 326417514499 2026-02-17T08:18:10.751 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836514 1-38654705696 2-55834574879 3-296352743431 4-94489280539 5-326417514499' 2026-02-17T08:18:10.751 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:10.751 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-17T08:18:10.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=133143986199 2026-02-17T08:18:10.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 133143986199 2026-02-17T08:18:10.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836514 1-38654705696 2-55834574879 3-296352743431 4-94489280539 5-326417514499 6-133143986199' 2026-02-17T08:18:10.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:10.826 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-17T08:18:10.901 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=150323855381 2026-02-17T08:18:10.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 150323855381 2026-02-17T08:18:10.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836514 1-38654705696 2-55834574879 3-296352743431 4-94489280539 5-326417514499 6-133143986199 7-150323855381' 2026-02-17T08:18:10.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:10.902 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-17T08:18:10.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=167503724563 2026-02-17T08:18:10.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 167503724563 2026-02-17T08:18:10.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836514 1-38654705696 2-55834574879 3-296352743431 4-94489280539 5-326417514499 6-133143986199 7-150323855381 8-167503724563' 2026-02-17T08:18:10.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:10.975 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-17T08:18:11.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=184683593747 2026-02-17T08:18:11.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 184683593747 2026-02-17T08:18:11.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836514 1-38654705696 2-55834574879 3-296352743431 4-94489280539 5-326417514499 6-133143986199 7-150323855381 8-167503724563 9-184683593747' 2026-02-17T08:18:11.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:11.050 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-17T08:18:11.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=201863462928 2026-02-17T08:18:11.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 201863462928 2026-02-17T08:18:11.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836514 1-38654705696 2-55834574879 3-296352743431 4-94489280539 5-326417514499 6-133143986199 7-150323855381 8-167503724563 9-184683593747 10-201863462928' 2026-02-17T08:18:11.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:11.126 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836514 2026-02-17T08:18:11.126 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:11.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:18:11.127 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836514 2026-02-17T08:18:11.128 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:11.129 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836514 2026-02-17T08:18:11.129 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836514' 2026-02-17T08:18:11.129 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.0 seq 21474836514 2026-02-17T08:18:11.130 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:18:11.326 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836512 -lt 21474836514 2026-02-17T08:18:11.326 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:18:12.327 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:18:12.327 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:18:12.521 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836514 -lt 21474836514 2026-02-17T08:18:12.521 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:12.522 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705696 2026-02-17T08:18:12.522 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:12.523 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:18:12.523 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705696 2026-02-17T08:18:12.523 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:12.525 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705696 2026-02-17T08:18:12.525 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705696' 2026-02-17T08:18:12.525 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.1 seq 38654705696 2026-02-17T08:18:12.525 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:18:12.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705696 -lt 38654705696 2026-02-17T08:18:12.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:12.728 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-55834574879 2026-02-17T08:18:12.728 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:12.729 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:18:12.729 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-55834574879 2026-02-17T08:18:12.729 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:12.731 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=55834574879 2026-02-17T08:18:12.731 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 55834574879' 2026-02-17T08:18:12.731 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.2 seq 55834574879 2026-02-17T08:18:12.731 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:18:12.937 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 55834574879 -lt 55834574879 2026-02-17T08:18:12.937 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:12.937 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-296352743431 2026-02-17T08:18:12.937 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:12.938 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:18:12.939 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-296352743431 2026-02-17T08:18:12.939 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:12.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=296352743431 2026-02-17T08:18:12.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 296352743431' 2026-02-17T08:18:12.940 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.3 seq 296352743431 2026-02-17T08:18:12.941 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:18:13.138 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 296352743432 -lt 296352743431 2026-02-17T08:18:13.138 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:13.139 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-94489280539 2026-02-17T08:18:13.139 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:13.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:18:13.141 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-94489280539 2026-02-17T08:18:13.141 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:13.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=94489280539 2026-02-17T08:18:13.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 94489280539' 2026-02-17T08:18:13.142 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.4 seq 94489280539 2026-02-17T08:18:13.142 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:18:13.349 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 94489280539 -lt 94489280539 2026-02-17T08:18:13.349 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:13.349 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 5-326417514499 2026-02-17T08:18:13.350 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:13.350 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=5 2026-02-17T08:18:13.351 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 5-326417514499 2026-02-17T08:18:13.351 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:13.352 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=326417514499 2026-02-17T08:18:13.352 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.5 seq 326417514499' 2026-02-17T08:18:13.353 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.5 seq 326417514499 2026-02-17T08:18:13.353 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T08:18:13.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 326417514499 -lt 326417514499 2026-02-17T08:18:13.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:13.556 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 6-133143986199 2026-02-17T08:18:13.556 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:13.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=6 2026-02-17T08:18:13.557 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 6-133143986199 2026-02-17T08:18:13.557 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:13.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=133143986199 2026-02-17T08:18:13.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.6 seq 133143986199' 2026-02-17T08:18:13.559 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.6 seq 133143986199 2026-02-17T08:18:13.559 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T08:18:13.764 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 133143986199 -lt 133143986199 2026-02-17T08:18:13.764 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:13.765 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 7-150323855381 2026-02-17T08:18:13.765 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:13.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=7 2026-02-17T08:18:13.767 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 7-150323855381 2026-02-17T08:18:13.767 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:13.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=150323855381 2026-02-17T08:18:13.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.7 seq 150323855381' 2026-02-17T08:18:13.768 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.7 seq 150323855381 2026-02-17T08:18:13.769 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T08:18:13.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 150323855382 -lt 150323855381 2026-02-17T08:18:13.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:13.975 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 8-167503724563 2026-02-17T08:18:13.975 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:13.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=8 2026-02-17T08:18:13.977 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 8-167503724563 2026-02-17T08:18:13.977 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:13.978 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=167503724563 2026-02-17T08:18:13.978 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.8 seq 167503724563' 2026-02-17T08:18:13.978 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.8 seq 167503724563 2026-02-17T08:18:13.978 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T08:18:14.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 167503724564 -lt 167503724563 2026-02-17T08:18:14.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:14.183 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 9-184683593747 2026-02-17T08:18:14.183 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:14.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=9 2026-02-17T08:18:14.185 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 9-184683593747 2026-02-17T08:18:14.185 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:14.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=184683593747 2026-02-17T08:18:14.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.9 seq 184683593747' 2026-02-17T08:18:14.187 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.9 seq 184683593747 2026-02-17T08:18:14.187 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T08:18:14.393 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 184683593747 -lt 184683593747 2026-02-17T08:18:14.393 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:14.394 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 10-201863462928 2026-02-17T08:18:14.394 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:14.395 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=10 2026-02-17T08:18:14.395 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 10-201863462928 2026-02-17T08:18:14.395 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:14.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=201863462928 2026-02-17T08:18:14.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.10 seq 201863462928' 2026-02-17T08:18:14.397 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.10 seq 201863462928 2026-02-17T08:18:14.397 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-17T08:18:14.600 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 201863462928 -lt 201863462928 2026-02-17T08:18:14.600 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:18:14.600 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:18:14.600 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:18:14.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 == 0 2026-02-17T08:18:14.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:18:14.861 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:18:14.861 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:18:14.861 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:18:14.861 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:18:14.861 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:18:14.861 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:18:15.056 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=16 2026-02-17T08:18:15.056 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:18:15.057 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:18:15.057 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:18:15.316 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 16 = 16 2026-02-17T08:18:15.317 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:18:15.317 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:18:15.317 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:313: TEST_chunk_mapping: ceph osd erasure-code-profile set remap-profile plugin=lrc 'layers=[ [ "cDD", "" ] ]' mapping=_DD 'crush-steps=[ [ "choose", "osd", 0 ] ]' 2026-02-17T08:18:15.542 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:318: TEST_chunk_mapping: ceph osd erasure-code-profile get remap-profile 2026-02-17T08:18:15.748 INFO:tasks.workunit.client.0.trial059.stdout:crush-device-class= 2026-02-17T08:18:15.748 INFO:tasks.workunit.client.0.trial059.stdout:crush-failure-domain=host 2026-02-17T08:18:15.748 INFO:tasks.workunit.client.0.trial059.stdout:crush-num-failure-domains=0 2026-02-17T08:18:15.748 INFO:tasks.workunit.client.0.trial059.stdout:crush-osds-per-failure-domain=0 2026-02-17T08:18:15.748 INFO:tasks.workunit.client.0.trial059.stdout:crush-root=default 2026-02-17T08:18:15.748 INFO:tasks.workunit.client.0.trial059.stdout:crush-steps=[ [ "choose", "osd", 0 ] ] 2026-02-17T08:18:15.748 INFO:tasks.workunit.client.0.trial059.stdout:k=-1 2026-02-17T08:18:15.748 INFO:tasks.workunit.client.0.trial059.stdout:l=-1 2026-02-17T08:18:15.748 INFO:tasks.workunit.client.0.trial059.stdout:layers=[ [ "cDD", "" ] ] 2026-02-17T08:18:15.748 INFO:tasks.workunit.client.0.trial059.stdout:m=-1 2026-02-17T08:18:15.748 INFO:tasks.workunit.client.0.trial059.stdout:mapping=_DD 2026-02-17T08:18:15.748 INFO:tasks.workunit.client.0.trial059.stdout:plugin=lrc 2026-02-17T08:18:15.757 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:319: TEST_chunk_mapping: create_pool remap-pool 12 12 erasure remap-profile 2026-02-17T08:18:15.757 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create remap-pool 12 12 erasure remap-profile 2026-02-17T08:18:16.103 INFO:tasks.workunit.client.0.trial059.stderr:pool 'remap-pool' already exists 2026-02-17T08:18:16.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:18:17.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:327: TEST_chunk_mapping: verify_chunk_mapping td/test-erasure-code remap-pool 1 2 2026-02-17T08:18:17.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:281: verify_chunk_mapping: local dir=td/test-erasure-code 2026-02-17T08:18:17.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:282: verify_chunk_mapping: local poolname=remap-pool 2026-02-17T08:18:17.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:283: verify_chunk_mapping: local first=1 2026-02-17T08:18:17.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:284: verify_chunk_mapping: local second=2 2026-02-17T08:18:17.116 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: chunk_size 2026-02-17T08:18:17.116 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:270: chunk_size: ceph-conf --show-config-value osd_pool_erasure_code_stripe_unit 2026-02-17T08:18:17.127 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:270: chunk_size: echo 4096 2026-02-17T08:18:17.128 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: printf '%*s' 4096 FIRSTremap-pool 2026-02-17T08:18:17.128 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: chunk_size 2026-02-17T08:18:17.128 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:270: chunk_size: ceph-conf --show-config-value osd_pool_erasure_code_stripe_unit 2026-02-17T08:18:17.136 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:270: chunk_size: echo 4096 2026-02-17T08:18:17.137 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: printf '%*s' 4096 SECONDremap-pool 2026-02-17T08:18:17.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:286: verify_chunk_mapping: local 'payload= FIRSTremap-pool SECONDremap-pool' 2026-02-17T08:18:17.138 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:287: verify_chunk_mapping: echo -n ' FIRSTremap-pool SECONDremap-pool' 2026-02-17T08:18:17.138 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:289: verify_chunk_mapping: rados --pool remap-pool put SOMETHINGremap-pool td/test-erasure-code/ORIGINAL 2026-02-17T08:18:17.164 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:290: verify_chunk_mapping: rados --pool remap-pool get SOMETHINGremap-pool td/test-erasure-code/COPY 2026-02-17T08:18:17.191 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:291: verify_chunk_mapping: get_osds remap-pool SOMETHINGremap-pool 2026-02-17T08:18:17.191 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=remap-pool 2026-02-17T08:18:17.191 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=SOMETHINGremap-pool 2026-02-17T08:18:17.191 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map remap-pool SOMETHINGremap-pool 2026-02-17T08:18:17.192 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:18:17.392 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=4 2026-02-17T08:18:17.392 INFO:tasks.workunit.client.0.trial059.stderr:6 2026-02-17T08:18:17.392 INFO:tasks.workunit.client.0.trial059.stderr:9' 2026-02-17T08:18:17.393 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 4 6 9 2026-02-17T08:18:17.393 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:291: verify_chunk_mapping: osds=('4' '6' '9') 2026-02-17T08:18:17.393 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:291: verify_chunk_mapping: local -a osds 2026-02-17T08:18:17.393 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i = 0 )) 2026-02-17T08:18:17.393 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 3 )) 2026-02-17T08:18:17.393 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:293: verify_chunk_mapping: ceph daemon osd.4 flush_journal 2026-02-17T08:18:17.458 INFO:tasks.workunit.client.0.trial059.stderr:Can't get admin socket path: unable to get conf option admin_socket for osd: b"error parsing 'osd': expected string of the form TYPE.ID, valid types are: auth, mon, osd, mds, mgr, client\n" 2026-02-17T08:18:17.460 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i++ )) 2026-02-17T08:18:17.460 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 3 )) 2026-02-17T08:18:17.460 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:293: verify_chunk_mapping: ceph daemon osd.6 flush_journal 2026-02-17T08:18:17.533 INFO:tasks.workunit.client.0.trial059.stderr:Can't get admin socket path: unable to get conf option admin_socket for osd: b"error parsing 'osd': expected string of the form TYPE.ID, valid types are: auth, mon, osd, mds, mgr, client\n" 2026-02-17T08:18:17.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i++ )) 2026-02-17T08:18:17.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 3 )) 2026-02-17T08:18:17.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:293: verify_chunk_mapping: ceph daemon osd.9 flush_journal 2026-02-17T08:18:17.605 INFO:tasks.workunit.client.0.trial059.stderr:Can't get admin socket path: unable to get conf option admin_socket for osd: b"error parsing 'osd': expected string of the form TYPE.ID, valid types are: auth, mon, osd, mds, mgr, client\n" 2026-02-17T08:18:17.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i++ )) 2026-02-17T08:18:17.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:292: verify_chunk_mapping: (( i < 3 )) 2026-02-17T08:18:17.607 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:295: verify_chunk_mapping: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-17T08:18:17.607 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:296: verify_chunk_mapping: rm td/test-erasure-code/COPY 2026-02-17T08:18:17.609 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:298: verify_chunk_mapping: get_osds remap-pool SOMETHINGremap-pool 2026-02-17T08:18:17.609 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=remap-pool 2026-02-17T08:18:17.609 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=SOMETHINGremap-pool 2026-02-17T08:18:17.610 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map remap-pool SOMETHINGremap-pool 2026-02-17T08:18:17.610 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:18:17.804 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=4 2026-02-17T08:18:17.805 INFO:tasks.workunit.client.0.trial059.stderr:6 2026-02-17T08:18:17.805 INFO:tasks.workunit.client.0.trial059.stderr:9' 2026-02-17T08:18:17.805 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 4 6 9 2026-02-17T08:18:17.805 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:298: verify_chunk_mapping: osds=('4' '6' '9') 2026-02-17T08:18:17.805 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:298: verify_chunk_mapping: local -a osds 2026-02-17T08:18:17.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:299: verify_chunk_mapping: objectstore_tool td/test-erasure-code 6 SOMETHINGremap-pool get-bytes 2026-02-17T08:18:17.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1297: objectstore_tool: local dir=td/test-erasure-code 2026-02-17T08:18:17.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: objectstore_tool: shift 2026-02-17T08:18:17.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1299: objectstore_tool: local id=6 2026-02-17T08:18:17.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: objectstore_tool: shift 2026-02-17T08:18:17.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: _objectstore_tool_nowait td/test-erasure-code 6 SOMETHINGremap-pool get-bytes 2026-02-17T08:18:17.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/test-erasure-code 2026-02-17T08:18:17.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2026-02-17T08:18:17.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=6 2026-02-17T08:18:17.808 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2026-02-17T08:18:17.808 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/test-erasure-code TERM osd.6 2026-02-17T08:18:17.808 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:299: verify_chunk_mapping: grep --quiet FIRSTremap-pool 2026-02-17T08:18:17.808 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:18:17.808 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:18:17.808 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:18:17.808 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:18:17.808 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:18:19.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:18:19.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-code 6 SOMETHINGremap-pool get-bytes 2026-02-17T08:18:19.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/test-erasure-code 2026-02-17T08:18:19.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T08:18:19.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=6 2026-02-17T08:18:19.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T08:18:19.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/test-erasure-code/6 2026-02-17T08:18:19.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-code/6 SOMETHINGremap-pool get-bytes 2026-02-17T08:18:19.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: _objectstore_tool_nowait: activate_osd td/test-erasure-code 6 2026-02-17T08:18:19.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-code 2026-02-17T08:18:19.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:18:19.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=6 2026-02-17T08:18:19.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:18:19.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-code/6 2026-02-17T08:18:19.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-17T08:18:19.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:18:19.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:18:19.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:18:19.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-code/6' 2026-02-17T08:18:19.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-code/6/journal' 2026-02-17T08:18:19.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:18:19.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:18:19.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-17T08:18:19.982 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:18:19.982 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:18:19.982 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:18:19.982 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:18:19.982 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:18:19.982 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:18:19.982 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:18:19.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:18:19.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:18:19.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-17T08:18:19.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-17T08:18:19.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:18:19.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:18:19.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:18:19.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:18:19.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:18:19.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:18:19.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-code/6 2026-02-17T08:18:19.984 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.6 2026-02-17T08:18:19.984 INFO:tasks.workunit.client.0.trial059.stderr:start osd.6 2026-02-17T08:18:19.984 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 6 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/6 --osd-journal=td/test-erasure-code/6/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:18:19.984 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-code/6/whoami 2026-02-17T08:18:19.985 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 6 = 6 ']' 2026-02-17T08:18:19.985 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:18:19.985 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:18:19.986 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:18:20.003 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:18:19.997+0000 7ffa50c518c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:18:20.004 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:18:19.997+0000 7ffa50c518c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:18:20.005 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:18:20.001+0000 7ffa50c518c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:18:20.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 6 2026-02-17T08:18:20.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:18:20.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=6 2026-02-17T08:18:20.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:18:20.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:18:20.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:18:20.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:18:20.187 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:18:20.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:18:20.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:18:20.382 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:18:21.238 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:18:21.233+0000 7ffa50c518c0 -1 Falling back to public interface 2026-02-17T08:18:21.383 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:18:21.384 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:18:21.384 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:18:21.384 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:18:21.384 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:18:21.384 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:18:21.576 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:18:22.577 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:18:22.577 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:18:22.577 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:18:22.577 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:18:22.577 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:18:22.577 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:18:22.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:18:23.775 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:18:23.775 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:18:23.775 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:18:23.775 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:18:23.775 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:18:23.775 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:18:23.969 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:18:24.304 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:18:24.297+0000 7ffa50c518c0 -1 osd.6 84 log_to_monitors true 2026-02-17T08:18:24.971 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:18:24.971 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:18:24.971 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:18:24.971 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:18:24.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:18:24.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:18:25.169 INFO:tasks.workunit.client.0.trial059.stderr:osd.6 up in weight 1 up_from 88 up_thru 88 down_at 85 last_clean_interval [31,84) [v2:127.0.0.1:6850/3108565365,v1:127.0.0.1:6851/3108565365] [v2:127.0.0.1:6852/3108565365,v1:127.0.0.1:6853/3108565365] exists,up 36445e95-af28-4ddf-842b-35d10821674c 2026-02-17T08:18:25.169 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:18:25.169 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:18:25.169 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:18:25.169 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: objectstore_tool: wait_for_clean 2026-02-17T08:18:25.169 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:18:25.169 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:18:25.169 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:18:25.169 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:18:25.169 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:18:25.169 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:18:25.169 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:18:25.169 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:18:25.169 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:18:25.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:18:25.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:18:25.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:18:25.272 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:18:25.272 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:18:25.272 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:18:25.470 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:18:25.471 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:18:25.471 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:18:25.471 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:18:25.471 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:18:25.471 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:18:25.471 INFO:tasks.workunit.client.0.trial059.stderr:6 2026-02-17T08:18:25.471 INFO:tasks.workunit.client.0.trial059.stderr:7 2026-02-17T08:18:25.471 INFO:tasks.workunit.client.0.trial059.stderr:8 2026-02-17T08:18:25.471 INFO:tasks.workunit.client.0.trial059.stderr:9 2026-02-17T08:18:25.471 INFO:tasks.workunit.client.0.trial059.stderr:10' 2026-02-17T08:18:25.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:18:25.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:25.471 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:18:25.545 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836519 2026-02-17T08:18:25.545 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836519 2026-02-17T08:18:25.546 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836519' 2026-02-17T08:18:25.546 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:25.546 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:18:25.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705701 2026-02-17T08:18:25.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705701 2026-02-17T08:18:25.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836519 1-38654705701' 2026-02-17T08:18:25.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:25.621 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:18:25.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=55834574884 2026-02-17T08:18:25.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 55834574884 2026-02-17T08:18:25.697 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836519 1-38654705701 2-55834574884' 2026-02-17T08:18:25.697 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:25.697 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:18:25.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=296352743436 2026-02-17T08:18:25.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 296352743436 2026-02-17T08:18:25.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836519 1-38654705701 2-55834574884 3-296352743436' 2026-02-17T08:18:25.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:25.774 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:18:25.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=94489280544 2026-02-17T08:18:25.850 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 94489280544 2026-02-17T08:18:25.850 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836519 1-38654705701 2-55834574884 3-296352743436 4-94489280544' 2026-02-17T08:18:25.850 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:25.850 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-17T08:18:25.925 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=326417514504 2026-02-17T08:18:25.925 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 326417514504 2026-02-17T08:18:25.925 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836519 1-38654705701 2-55834574884 3-296352743436 4-94489280544 5-326417514504' 2026-02-17T08:18:25.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:25.926 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-17T08:18:25.999 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=377957122051 2026-02-17T08:18:25.999 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 377957122051 2026-02-17T08:18:25.999 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836519 1-38654705701 2-55834574884 3-296352743436 4-94489280544 5-326417514504 6-377957122051' 2026-02-17T08:18:25.999 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:25.999 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-17T08:18:26.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=150323855386 2026-02-17T08:18:26.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 150323855386 2026-02-17T08:18:26.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836519 1-38654705701 2-55834574884 3-296352743436 4-94489280544 5-326417514504 6-377957122051 7-150323855386' 2026-02-17T08:18:26.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:26.074 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-17T08:18:26.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=167503724569 2026-02-17T08:18:26.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 167503724569 2026-02-17T08:18:26.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836519 1-38654705701 2-55834574884 3-296352743436 4-94489280544 5-326417514504 6-377957122051 7-150323855386 8-167503724569' 2026-02-17T08:18:26.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:26.149 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-17T08:18:26.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=184683593752 2026-02-17T08:18:26.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 184683593752 2026-02-17T08:18:26.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836519 1-38654705701 2-55834574884 3-296352743436 4-94489280544 5-326417514504 6-377957122051 7-150323855386 8-167503724569 9-184683593752' 2026-02-17T08:18:26.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:26.228 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-17T08:18:26.302 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=201863462933 2026-02-17T08:18:26.302 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 201863462933 2026-02-17T08:18:26.302 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836519 1-38654705701 2-55834574884 3-296352743436 4-94489280544 5-326417514504 6-377957122051 7-150323855386 8-167503724569 9-184683593752 10-201863462933' 2026-02-17T08:18:26.302 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:26.303 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836519 2026-02-17T08:18:26.303 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:26.303 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:18:26.304 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836519 2026-02-17T08:18:26.304 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:26.305 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836519 2026-02-17T08:18:26.305 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836519' 2026-02-17T08:18:26.306 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.0 seq 21474836519 2026-02-17T08:18:26.306 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:18:26.509 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836519 -lt 21474836519 2026-02-17T08:18:26.510 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:26.510 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705701 2026-02-17T08:18:26.510 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:26.511 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:18:26.512 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705701 2026-02-17T08:18:26.512 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:26.513 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705701 2026-02-17T08:18:26.513 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705701' 2026-02-17T08:18:26.513 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.1 seq 38654705701 2026-02-17T08:18:26.514 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:18:26.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705701 -lt 38654705701 2026-02-17T08:18:26.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:26.711 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-55834574884 2026-02-17T08:18:26.711 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:26.711 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:18:26.712 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-55834574884 2026-02-17T08:18:26.712 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:26.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=55834574884 2026-02-17T08:18:26.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 55834574884' 2026-02-17T08:18:26.713 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.2 seq 55834574884 2026-02-17T08:18:26.713 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:18:26.916 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 55834574884 -lt 55834574884 2026-02-17T08:18:26.916 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:26.917 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-296352743436 2026-02-17T08:18:26.917 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:26.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:18:26.918 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-296352743436 2026-02-17T08:18:26.918 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:26.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=296352743436 2026-02-17T08:18:26.920 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 296352743436' 2026-02-17T08:18:26.920 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.3 seq 296352743436 2026-02-17T08:18:26.920 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:18:27.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 296352743436 -lt 296352743436 2026-02-17T08:18:27.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:27.124 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-94489280544 2026-02-17T08:18:27.124 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:27.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:18:27.125 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-94489280544 2026-02-17T08:18:27.126 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:27.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=94489280544 2026-02-17T08:18:27.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 94489280544' 2026-02-17T08:18:27.127 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.4 seq 94489280544 2026-02-17T08:18:27.127 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:18:27.328 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 94489280544 -lt 94489280544 2026-02-17T08:18:27.328 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:27.329 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 5-326417514504 2026-02-17T08:18:27.329 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:27.329 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=5 2026-02-17T08:18:27.330 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 5-326417514504 2026-02-17T08:18:27.330 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:27.332 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=326417514504 2026-02-17T08:18:27.332 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.5 seq 326417514504' 2026-02-17T08:18:27.332 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.5 seq 326417514504 2026-02-17T08:18:27.332 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T08:18:27.545 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 326417514504 -lt 326417514504 2026-02-17T08:18:27.545 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:27.546 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 6-377957122051 2026-02-17T08:18:27.546 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:27.546 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=6 2026-02-17T08:18:27.547 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 6-377957122051 2026-02-17T08:18:27.547 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:27.548 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=377957122051 2026-02-17T08:18:27.548 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.6 seq 377957122051' 2026-02-17T08:18:27.548 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.6 seq 377957122051 2026-02-17T08:18:27.549 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T08:18:27.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 1 -lt 377957122051 2026-02-17T08:18:27.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:18:28.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:18:28.750 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T08:18:28.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 377957122051 -lt 377957122051 2026-02-17T08:18:28.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:28.949 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 7-150323855386 2026-02-17T08:18:28.950 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:28.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=7 2026-02-17T08:18:28.951 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 7-150323855386 2026-02-17T08:18:28.951 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:28.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=150323855386 2026-02-17T08:18:28.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.7 seq 150323855386' 2026-02-17T08:18:28.953 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.7 seq 150323855386 2026-02-17T08:18:28.953 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T08:18:29.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 150323855387 -lt 150323855386 2026-02-17T08:18:29.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:29.146 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 8-167503724569 2026-02-17T08:18:29.146 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:29.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=8 2026-02-17T08:18:29.148 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 8-167503724569 2026-02-17T08:18:29.148 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:29.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=167503724569 2026-02-17T08:18:29.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.8 seq 167503724569' 2026-02-17T08:18:29.149 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.8 seq 167503724569 2026-02-17T08:18:29.149 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T08:18:29.349 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 167503724569 -lt 167503724569 2026-02-17T08:18:29.349 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:29.349 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 9-184683593752 2026-02-17T08:18:29.349 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:29.350 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=9 2026-02-17T08:18:29.351 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 9-184683593752 2026-02-17T08:18:29.351 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:29.352 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=184683593752 2026-02-17T08:18:29.352 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.9 seq 184683593752' 2026-02-17T08:18:29.352 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.9 seq 184683593752 2026-02-17T08:18:29.353 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T08:18:29.547 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 184683593752 -lt 184683593752 2026-02-17T08:18:29.547 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:29.547 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 10-201863462933 2026-02-17T08:18:29.547 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:29.549 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=10 2026-02-17T08:18:29.549 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 10-201863462933 2026-02-17T08:18:29.549 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:29.551 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=201863462933 2026-02-17T08:18:29.551 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.10 seq 201863462933' 2026-02-17T08:18:29.551 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.10 seq 201863462933 2026-02-17T08:18:29.551 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-17T08:18:29.759 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 201863462933 -lt 201863462933 2026-02-17T08:18:29.760 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:18:29.760 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:18:29.760 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:18:30.020 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 28 == 0 2026-02-17T08:18:30.020 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:18:30.021 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:18:30.021 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:18:30.021 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:18:30.021 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:18:30.021 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:18:30.021 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:18:30.216 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=28 2026-02-17T08:18:30.216 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:18:30.216 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:18:30.217 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:18:30.476 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 28 = 28 2026-02-17T08:18:30.476 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:18:30.476 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:18:30.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:300: verify_chunk_mapping: objectstore_tool td/test-erasure-code 9 SOMETHINGremap-pool get-bytes 2026-02-17T08:18:30.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1297: objectstore_tool: local dir=td/test-erasure-code 2026-02-17T08:18:30.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:300: verify_chunk_mapping: grep --quiet SECONDremap-pool 2026-02-17T08:18:30.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: objectstore_tool: shift 2026-02-17T08:18:30.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1299: objectstore_tool: local id=9 2026-02-17T08:18:30.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: objectstore_tool: shift 2026-02-17T08:18:30.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: _objectstore_tool_nowait td/test-erasure-code 9 SOMETHINGremap-pool get-bytes 2026-02-17T08:18:30.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/test-erasure-code 2026-02-17T08:18:30.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2026-02-17T08:18:30.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=9 2026-02-17T08:18:30.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2026-02-17T08:18:30.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/test-erasure-code TERM osd.9 2026-02-17T08:18:30.480 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:18:30.480 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:18:30.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:18:30.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:18:30.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:18:31.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:18:31.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-code 9 SOMETHINGremap-pool get-bytes 2026-02-17T08:18:31.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/test-erasure-code 2026-02-17T08:18:31.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T08:18:31.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=9 2026-02-17T08:18:31.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T08:18:31.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/test-erasure-code/9 2026-02-17T08:18:31.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-code/9 SOMETHINGremap-pool get-bytes 2026-02-17T08:18:32.641 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: _objectstore_tool_nowait: activate_osd td/test-erasure-code 9 2026-02-17T08:18:32.641 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-code 2026-02-17T08:18:32.641 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:18:32.641 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=9 2026-02-17T08:18:32.641 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:18:32.641 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-code/9 2026-02-17T08:18:32.641 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false' 2026-02-17T08:18:32.641 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:18:32.641 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:18:32.641 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:18:32.641 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-code/9' 2026-02-17T08:18:32.642 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-code/9/journal' 2026-02-17T08:18:32.642 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:18:32.642 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:18:32.642 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-code' 2026-02-17T08:18:32.642 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:18:32.643 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:18:32.643 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:18:32.643 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:18:32.643 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:18:32.643 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:18:32.644 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:18:32.644 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' 2026-02-17T08:18:32.644 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:18:32.644 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-code/$name.log' 2026-02-17T08:18:32.644 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-code/$name.pid' 2026-02-17T08:18:32.644 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:18:32.644 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:18:32.645 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:18:32.645 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:18:32.645 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:18:32.645 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:18:32.645 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-code/9 2026-02-17T08:18:32.645 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.9 2026-02-17T08:18:32.645 INFO:tasks.workunit.client.0.trial059.stderr:start osd.9 2026-02-17T08:18:32.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 9 --fsid=4024c55f-57b9-4405-863d-1ee5bdee6ef6 --auth-supported=none --mon-host=127.0.0.1:7101 --mon-osd-prime-pg-temp=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-code/9 --osd-journal=td/test-erasure-code/9/journal --chdir= --run-dir=td/test-erasure-code '--admin-socket=/tmp/ceph-asok.41658/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-code/$name.log' '--pid-file=td/test-erasure-code/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:18:32.646 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-code/9/whoami 2026-02-17T08:18:32.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 9 = 9 ']' 2026-02-17T08:18:32.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:18:32.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:18:32.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:18:32.667 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:18:32.661+0000 7f70adb1a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:18:32.668 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:18:32.665+0000 7f70adb1a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:18:32.669 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:18:32.665+0000 7f70adb1a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:18:32.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 9 2026-02-17T08:18:32.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:18:32.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=9 2026-02-17T08:18:32.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:18:32.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:18:32.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:18:32.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:18:32.849 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:18:32.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:18:32.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2026-02-17T08:18:33.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:18:33.914 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:18:33.909+0000 7f70adb1a8c0 -1 Falling back to public interface 2026-02-17T08:18:34.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:18:34.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:18:34.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:18:34.048 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:18:34.049 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:18:34.049 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2026-02-17T08:18:34.241 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:18:35.243 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:18:35.243 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:18:35.243 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:18:35.243 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:18:35.243 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:18:35.244 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2026-02-17T08:18:35.438 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:18:36.439 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:18:36.440 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:18:36.440 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:18:36.440 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:18:36.440 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:18:36.440 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2026-02-17T08:18:36.637 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:18:37.186 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:18:37.181+0000 7f70adb1a8c0 -1 osd.9 90 log_to_monitors true 2026-02-17T08:18:37.638 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:18:37.638 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:18:37.638 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:18:37.639 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:18:37.639 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:18:37.639 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.9 up' 2026-02-17T08:18:37.838 INFO:tasks.workunit.client.0.trial059.stderr:osd.9 up in weight 1 up_from 94 up_thru 94 down_at 91 last_clean_interval [43,90) [v2:127.0.0.1:6874/1147715913,v1:127.0.0.1:6875/1147715913] [v2:127.0.0.1:6876/1147715913,v1:127.0.0.1:6877/1147715913] exists,up ecbc4e41-54f3-4945-9c40-3f81811b5d29 2026-02-17T08:18:37.839 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:18:37.839 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:18:37.839 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:18:37.839 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: objectstore_tool: wait_for_clean 2026-02-17T08:18:37.839 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:18:37.839 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:18:37.839 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:18:37.839 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:18:37.839 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:18:37.839 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:18:37.840 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:18:37.840 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:18:37.840 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:18:37.935 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:18:37.935 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:18:37.935 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:18:37.935 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:18:37.935 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:18:37.935 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:18:38.134 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:18:38.134 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:18:38.134 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:18:38.134 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:18:38.134 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:18:38.134 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:18:38.134 INFO:tasks.workunit.client.0.trial059.stderr:6 2026-02-17T08:18:38.134 INFO:tasks.workunit.client.0.trial059.stderr:7 2026-02-17T08:18:38.135 INFO:tasks.workunit.client.0.trial059.stderr:8 2026-02-17T08:18:38.135 INFO:tasks.workunit.client.0.trial059.stderr:9 2026-02-17T08:18:38.135 INFO:tasks.workunit.client.0.trial059.stderr:10' 2026-02-17T08:18:38.135 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:18:38.135 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:38.135 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:18:38.207 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836523 2026-02-17T08:18:38.208 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836523 2026-02-17T08:18:38.208 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836523' 2026-02-17T08:18:38.208 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:38.208 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:18:38.282 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705705 2026-02-17T08:18:38.282 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705705 2026-02-17T08:18:38.282 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836523 1-38654705705' 2026-02-17T08:18:38.282 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:38.282 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:18:38.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=55834574889 2026-02-17T08:18:38.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 55834574889 2026-02-17T08:18:38.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836523 1-38654705705 2-55834574889' 2026-02-17T08:18:38.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:38.361 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:18:38.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=296352743441 2026-02-17T08:18:38.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 296352743441 2026-02-17T08:18:38.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836523 1-38654705705 2-55834574889 3-296352743441' 2026-02-17T08:18:38.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:38.434 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:18:38.510 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=94489280548 2026-02-17T08:18:38.510 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 94489280548 2026-02-17T08:18:38.510 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836523 1-38654705705 2-55834574889 3-296352743441 4-94489280548' 2026-02-17T08:18:38.511 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:38.511 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-17T08:18:38.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=326417514508 2026-02-17T08:18:38.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 326417514508 2026-02-17T08:18:38.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836523 1-38654705705 2-55834574889 3-296352743441 4-94489280548 5-326417514508' 2026-02-17T08:18:38.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:38.585 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-17T08:18:38.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=377957122055 2026-02-17T08:18:38.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 377957122055 2026-02-17T08:18:38.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836523 1-38654705705 2-55834574889 3-296352743441 4-94489280548 5-326417514508 6-377957122055' 2026-02-17T08:18:38.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:38.659 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-17T08:18:38.733 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=150323855391 2026-02-17T08:18:38.733 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 150323855391 2026-02-17T08:18:38.733 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836523 1-38654705705 2-55834574889 3-296352743441 4-94489280548 5-326417514508 6-377957122055 7-150323855391' 2026-02-17T08:18:38.733 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:38.733 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-17T08:18:38.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=167503724573 2026-02-17T08:18:38.812 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 167503724573 2026-02-17T08:18:38.812 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836523 1-38654705705 2-55834574889 3-296352743441 4-94489280548 5-326417514508 6-377957122055 7-150323855391 8-167503724573' 2026-02-17T08:18:38.812 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:38.812 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-17T08:18:38.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=403726925827 2026-02-17T08:18:38.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 403726925827 2026-02-17T08:18:38.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836523 1-38654705705 2-55834574889 3-296352743441 4-94489280548 5-326417514508 6-377957122055 7-150323855391 8-167503724573 9-403726925827' 2026-02-17T08:18:38.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:18:38.886 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-17T08:18:38.964 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=201863462937 2026-02-17T08:18:38.964 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 201863462937 2026-02-17T08:18:38.964 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836523 1-38654705705 2-55834574889 3-296352743441 4-94489280548 5-326417514508 6-377957122055 7-150323855391 8-167503724573 9-403726925827 10-201863462937' 2026-02-17T08:18:38.964 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:38.965 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836523 2026-02-17T08:18:38.965 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:38.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:18:38.966 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836523 2026-02-17T08:18:38.967 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:38.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836523 2026-02-17T08:18:38.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836523' 2026-02-17T08:18:38.968 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.0 seq 21474836523 2026-02-17T08:18:38.969 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:18:39.170 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836521 -lt 21474836523 2026-02-17T08:18:39.170 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:18:40.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:18:40.171 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:18:40.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836524 -lt 21474836523 2026-02-17T08:18:40.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:40.366 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705705 2026-02-17T08:18:40.366 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:40.367 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:18:40.368 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705705 2026-02-17T08:18:40.368 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:40.369 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705705 2026-02-17T08:18:40.369 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705705' 2026-02-17T08:18:40.369 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.1 seq 38654705705 2026-02-17T08:18:40.369 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:18:40.577 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705706 -lt 38654705705 2026-02-17T08:18:40.578 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:40.578 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-55834574889 2026-02-17T08:18:40.578 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:40.579 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:18:40.580 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-55834574889 2026-02-17T08:18:40.580 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:40.581 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=55834574889 2026-02-17T08:18:40.581 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 55834574889' 2026-02-17T08:18:40.581 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.2 seq 55834574889 2026-02-17T08:18:40.581 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:18:40.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 55834574889 -lt 55834574889 2026-02-17T08:18:40.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:40.777 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-296352743441 2026-02-17T08:18:40.778 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:40.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:18:40.779 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-296352743441 2026-02-17T08:18:40.780 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:40.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=296352743441 2026-02-17T08:18:40.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 296352743441' 2026-02-17T08:18:40.781 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.3 seq 296352743441 2026-02-17T08:18:40.781 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:18:40.984 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 296352743441 -lt 296352743441 2026-02-17T08:18:40.984 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:40.985 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-94489280548 2026-02-17T08:18:40.985 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:40.986 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:18:40.987 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-94489280548 2026-02-17T08:18:40.987 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:40.988 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=94489280548 2026-02-17T08:18:40.988 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 94489280548' 2026-02-17T08:18:40.988 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.4 seq 94489280548 2026-02-17T08:18:40.989 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:18:41.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 94489280548 -lt 94489280548 2026-02-17T08:18:41.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:41.187 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 5-326417514508 2026-02-17T08:18:41.188 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:41.188 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=5 2026-02-17T08:18:41.189 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 5-326417514508 2026-02-17T08:18:41.189 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:41.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=326417514508 2026-02-17T08:18:41.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.5 seq 326417514508' 2026-02-17T08:18:41.190 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.5 seq 326417514508 2026-02-17T08:18:41.191 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T08:18:41.391 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 326417514509 -lt 326417514508 2026-02-17T08:18:41.391 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:41.392 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 6-377957122055 2026-02-17T08:18:41.392 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:41.393 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=6 2026-02-17T08:18:41.394 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 6-377957122055 2026-02-17T08:18:41.394 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:41.395 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=377957122055 2026-02-17T08:18:41.395 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.6 seq 377957122055' 2026-02-17T08:18:41.395 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.6 seq 377957122055 2026-02-17T08:18:41.395 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T08:18:41.596 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 377957122056 -lt 377957122055 2026-02-17T08:18:41.596 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:41.596 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 7-150323855391 2026-02-17T08:18:41.596 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:41.597 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=7 2026-02-17T08:18:41.598 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 7-150323855391 2026-02-17T08:18:41.598 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:41.600 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=150323855391 2026-02-17T08:18:41.600 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.7 seq 150323855391' 2026-02-17T08:18:41.600 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.7 seq 150323855391 2026-02-17T08:18:41.600 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T08:18:41.813 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 150323855391 -lt 150323855391 2026-02-17T08:18:41.813 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:41.814 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 8-167503724573 2026-02-17T08:18:41.814 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:41.814 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=8 2026-02-17T08:18:41.815 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 8-167503724573 2026-02-17T08:18:41.815 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:41.817 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=167503724573 2026-02-17T08:18:41.817 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.8 seq 167503724573' 2026-02-17T08:18:41.817 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.8 seq 167503724573 2026-02-17T08:18:41.817 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T08:18:42.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 167503724573 -lt 167503724573 2026-02-17T08:18:42.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:42.019 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 9-403726925827 2026-02-17T08:18:42.019 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:42.020 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=9 2026-02-17T08:18:42.020 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 9-403726925827 2026-02-17T08:18:42.020 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:42.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=403726925827 2026-02-17T08:18:42.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.9 seq 403726925827' 2026-02-17T08:18:42.022 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.9 seq 403726925827 2026-02-17T08:18:42.022 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T08:18:42.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 403726925827 -lt 403726925827 2026-02-17T08:18:42.230 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:18:42.230 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 10-201863462937 2026-02-17T08:18:42.230 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:18:42.231 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=10 2026-02-17T08:18:42.232 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 10-201863462937 2026-02-17T08:18:42.232 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:18:42.233 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=201863462937 2026-02-17T08:18:42.233 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.10 seq 201863462937' 2026-02-17T08:18:42.233 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.10 seq 201863462937 2026-02-17T08:18:42.234 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-17T08:18:42.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 201863462938 -lt 201863462937 2026-02-17T08:18:42.432 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:18:42.433 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:18:42.433 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:18:42.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 28 == 0 2026-02-17T08:18:42.687 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:18:42.687 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:18:42.687 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:18:42.687 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:18:42.687 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:18:42.687 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:18:42.687 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:18:42.879 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=28 2026-02-17T08:18:42.879 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:18:42.880 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:18:42.880 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:18:43.131 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 28 = 28 2026-02-17T08:18:43.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:18:43.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:18:43.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:329: TEST_chunk_mapping: delete_pool remap-pool 2026-02-17T08:18:43.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=remap-pool 2026-02-17T08:18:43.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete remap-pool remap-pool --yes-i-really-really-mean-it 2026-02-17T08:18:43.347 INFO:tasks.workunit.client.0.trial059.stderr:pool 'remap-pool' does not exist 2026-02-17T08:18:43.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:330: TEST_chunk_mapping: ceph osd erasure-code-profile rm remap-profile 2026-02-17T08:18:43.600 INFO:tasks.workunit.client.0.trial059.stderr:erasure-code-profile remap-profile does not exist 2026-02-17T08:18:43.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:47: run: for func in $funcs 2026-02-17T08:18:43.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:48: run: TEST_rados_put_get_isa td/test-erasure-code 2026-02-17T08:18:43.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:193: TEST_rados_put_get_isa: erasure_code_plugin_exists isa 2026-02-17T08:18:43.612 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2114: erasure_code_plugin_exists: local plugin=isa 2026-02-17T08:18:43.612 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2115: erasure_code_plugin_exists: local status 2026-02-17T08:18:43.612 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2116: erasure_code_plugin_exists: local grepstr 2026-02-17T08:18:43.612 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2117: erasure_code_plugin_exists: local s 2026-02-17T08:18:43.612 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2118: erasure_code_plugin_exists: case `uname` in 2026-02-17T08:18:43.612 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2118: erasure_code_plugin_exists: uname 2026-02-17T08:18:43.612 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2120: erasure_code_plugin_exists: grepstr='isa.*No such file' 2026-02-17T08:18:43.613 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2123: erasure_code_plugin_exists: ceph osd erasure-code-profile set TESTPROFILE plugin=isa 2026-02-17T08:18:43.871 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2123: erasure_code_plugin_exists: s= 2026-02-17T08:18:43.871 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2124: erasure_code_plugin_exists: local status=0 2026-02-17T08:18:43.871 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2125: erasure_code_plugin_exists: '[' 0 -eq 0 ']' 2026-02-17T08:18:43.871 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2126: erasure_code_plugin_exists: ceph osd erasure-code-profile rm TESTPROFILE 2026-02-17T08:18:44.166 INFO:tasks.workunit.client.0.trial059.stderr:erasure-code-profile TESTPROFILE does not exist 2026-02-17T08:18:44.176 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2132: erasure_code_plugin_exists: return 0 2026-02-17T08:18:44.176 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:197: TEST_rados_put_get_isa: local dir=td/test-erasure-code 2026-02-17T08:18:44.176 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:198: TEST_rados_put_get_isa: local poolname=pool-isa 2026-02-17T08:18:44.176 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:200: TEST_rados_put_get_isa: ceph osd erasure-code-profile set profile-isa plugin=isa crush-failure-domain=osd 2026-02-17T08:18:44.442 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:203: TEST_rados_put_get_isa: create_pool pool-isa 1 1 erasure profile-isa 2026-02-17T08:18:44.443 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create pool-isa 1 1 erasure profile-isa 2026-02-17T08:18:44.796 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-isa' already exists 2026-02-17T08:18:44.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:18:45.809 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:206: TEST_rados_put_get_isa: rados_put_get td/test-erasure-code pool-isa 2026-02-17T08:18:45.809 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:66: rados_put_get: local dir=td/test-erasure-code 2026-02-17T08:18:45.809 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:67: rados_put_get: local poolname=pool-isa 2026-02-17T08:18:45.809 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:68: rados_put_get: local objname=SOMETHING 2026-02-17T08:18:45.809 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-17T08:18:45.809 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 AAA 2026-02-17T08:18:45.809 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-17T08:18:45.810 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 BBB 2026-02-17T08:18:45.810 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-17T08:18:45.810 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 CCCC 2026-02-17T08:18:45.810 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-17T08:18:45.810 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 DDDD 2026-02-17T08:18:45.810 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:78: rados_put_get: rados --pool pool-isa put SOMETHING td/test-erasure-code/ORIGINAL 2026-02-17T08:18:45.828 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:79: rados_put_get: rados --pool pool-isa get SOMETHING td/test-erasure-code/COPY 2026-02-17T08:18:45.852 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:80: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-17T08:18:45.853 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:81: rados_put_get: rm td/test-erasure-code/COPY 2026-02-17T08:18:45.855 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: get_osds pool-isa SOMETHING 2026-02-17T08:18:45.855 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-isa 2026-02-17T08:18:45.856 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=SOMETHING 2026-02-17T08:18:45.856 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-isa SOMETHING 2026-02-17T08:18:45.856 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:18:46.055 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=4 2026-02-17T08:18:46.055 INFO:tasks.workunit.client.0.trial059.stderr:10 2026-02-17T08:18:46.055 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:18:46.055 INFO:tasks.workunit.client.0.trial059.stderr:7 2026-02-17T08:18:46.055 INFO:tasks.workunit.client.0.trial059.stderr:6 2026-02-17T08:18:46.055 INFO:tasks.workunit.client.0.trial059.stderr:8 2026-02-17T08:18:46.056 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:18:46.056 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:18:46.056 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:18:46.056 INFO:tasks.workunit.client.0.trial059.stderr:9' 2026-02-17T08:18:46.056 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 4 10 0 7 6 8 2 1 5 9 2026-02-17T08:18:46.056 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: initial_osds=('4' '10' '0' '7' '6' '8' '2' '1' '5' '9') 2026-02-17T08:18:46.056 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: local -a initial_osds 2026-02-17T08:18:46.056 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:89: rados_put_get: local last=9 2026-02-17T08:18:46.056 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:90: rados_put_get: ceph osd out 9 2026-02-17T08:18:46.306 INFO:tasks.workunit.client.0.trial059.stderr:osd.9 is already out. 2026-02-17T08:18:46.315 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:93: rados_put_get: sleep 5 2026-02-17T08:18:51.318 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: get_osds pool-isa SOMETHING 2026-02-17T08:18:51.318 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-isa 2026-02-17T08:18:51.318 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=SOMETHING 2026-02-17T08:18:51.318 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: grep '\<9\>' 2026-02-17T08:18:51.319 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-isa SOMETHING 2026-02-17T08:18:51.319 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:18:51.521 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=4 2026-02-17T08:18:51.522 INFO:tasks.workunit.client.0.trial059.stderr:10 2026-02-17T08:18:51.522 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:18:51.522 INFO:tasks.workunit.client.0.trial059.stderr:7 2026-02-17T08:18:51.522 INFO:tasks.workunit.client.0.trial059.stderr:6 2026-02-17T08:18:51.522 INFO:tasks.workunit.client.0.trial059.stderr:8 2026-02-17T08:18:51.522 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:18:51.522 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:18:51.522 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:18:51.523 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:18:51.523 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 4 10 0 7 6 8 3 1 5 2 2026-02-17T08:18:51.523 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:96: rados_put_get: rados --pool pool-isa get SOMETHING td/test-erasure-code/COPY 2026-02-17T08:18:51.540 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:97: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-17T08:18:51.541 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:98: rados_put_get: ceph osd in 9 2026-02-17T08:18:51.799 INFO:tasks.workunit.client.0.trial059.stderr:osd.9 is already in. 2026-02-17T08:18:51.810 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:100: rados_put_get: rm td/test-erasure-code/ORIGINAL 2026-02-17T08:18:51.810 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:208: TEST_rados_put_get_isa: delete_pool pool-isa 2026-02-17T08:18:51.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=pool-isa 2026-02-17T08:18:51.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete pool-isa pool-isa --yes-i-really-really-mean-it 2026-02-17T08:18:52.101 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-isa' does not exist 2026-02-17T08:18:52.111 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:47: run: for func in $funcs 2026-02-17T08:18:52.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:48: run: TEST_rados_put_get_jerasure td/test-erasure-code 2026-02-17T08:18:52.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:212: TEST_rados_put_get_jerasure: local dir=td/test-erasure-code 2026-02-17T08:18:52.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:214: TEST_rados_put_get_jerasure: rados_put_get td/test-erasure-code ecpool 2026-02-17T08:18:52.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:66: rados_put_get: local dir=td/test-erasure-code 2026-02-17T08:18:52.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:67: rados_put_get: local poolname=ecpool 2026-02-17T08:18:52.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:68: rados_put_get: local objname=SOMETHING 2026-02-17T08:18:52.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-17T08:18:52.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 AAA 2026-02-17T08:18:52.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-17T08:18:52.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 BBB 2026-02-17T08:18:52.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-17T08:18:52.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 CCCC 2026-02-17T08:18:52.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-17T08:18:52.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 DDDD 2026-02-17T08:18:52.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:78: rados_put_get: rados --pool ecpool put SOMETHING td/test-erasure-code/ORIGINAL 2026-02-17T08:18:52.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:79: rados_put_get: rados --pool ecpool get SOMETHING td/test-erasure-code/COPY 2026-02-17T08:18:52.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:80: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-17T08:18:52.151 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:81: rados_put_get: rm td/test-erasure-code/COPY 2026-02-17T08:18:52.153 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: get_osds ecpool SOMETHING 2026-02-17T08:18:52.153 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=ecpool 2026-02-17T08:18:52.153 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=SOMETHING 2026-02-17T08:18:52.153 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map ecpool SOMETHING 2026-02-17T08:18:52.153 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:18:52.354 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=6 2026-02-17T08:18:52.354 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:18:52.354 INFO:tasks.workunit.client.0.trial059.stderr:7 2026-02-17T08:18:52.354 INFO:tasks.workunit.client.0.trial059.stderr:9' 2026-02-17T08:18:52.354 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 6 0 7 9 2026-02-17T08:18:52.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: initial_osds=('6' '0' '7' '9') 2026-02-17T08:18:52.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: local -a initial_osds 2026-02-17T08:18:52.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:89: rados_put_get: local last=3 2026-02-17T08:18:52.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:90: rados_put_get: ceph osd out 9 2026-02-17T08:18:52.600 INFO:tasks.workunit.client.0.trial059.stderr:osd.9 is already out. 2026-02-17T08:18:52.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:93: rados_put_get: sleep 5 2026-02-17T08:18:57.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: get_osds ecpool SOMETHING 2026-02-17T08:18:57.612 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=ecpool 2026-02-17T08:18:57.612 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=SOMETHING 2026-02-17T08:18:57.612 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: grep '\<9\>' 2026-02-17T08:18:57.612 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map ecpool SOMETHING 2026-02-17T08:18:57.612 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:18:57.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=6 2026-02-17T08:18:57.812 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:18:57.812 INFO:tasks.workunit.client.0.trial059.stderr:7 2026-02-17T08:18:57.812 INFO:tasks.workunit.client.0.trial059.stderr:5' 2026-02-17T08:18:57.812 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 6 0 7 5 2026-02-17T08:18:57.812 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:96: rados_put_get: rados --pool ecpool get SOMETHING td/test-erasure-code/COPY 2026-02-17T08:18:57.830 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:97: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-17T08:18:57.830 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:98: rados_put_get: ceph osd in 9 2026-02-17T08:18:58.077 INFO:tasks.workunit.client.0.trial059.stderr:osd.9 is already in. 2026-02-17T08:18:58.086 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:100: rados_put_get: rm td/test-erasure-code/ORIGINAL 2026-02-17T08:18:58.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:216: TEST_rados_put_get_jerasure: local poolname=pool-jerasure 2026-02-17T08:18:58.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:217: TEST_rados_put_get_jerasure: local profile=profile-jerasure 2026-02-17T08:18:58.088 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:219: TEST_rados_put_get_jerasure: ceph osd erasure-code-profile set profile-jerasure plugin=jerasure k=4 m=2 crush-failure-domain=osd 2026-02-17T08:18:58.390 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:223: TEST_rados_put_get_jerasure: create_pool pool-jerasure 12 12 erasure profile-jerasure 2026-02-17T08:18:58.391 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create pool-jerasure 12 12 erasure profile-jerasure 2026-02-17T08:18:58.683 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' already exists 2026-02-17T08:18:58.692 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:18:59.694 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:226: TEST_rados_put_get_jerasure: rados_put_get td/test-erasure-code pool-jerasure 2026-02-17T08:18:59.694 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:66: rados_put_get: local dir=td/test-erasure-code 2026-02-17T08:18:59.694 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:67: rados_put_get: local poolname=pool-jerasure 2026-02-17T08:18:59.694 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:68: rados_put_get: local objname=SOMETHING 2026-02-17T08:18:59.694 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-17T08:18:59.694 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 AAA 2026-02-17T08:18:59.694 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-17T08:18:59.694 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 BBB 2026-02-17T08:18:59.694 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-17T08:18:59.694 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 CCCC 2026-02-17T08:18:59.694 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-17T08:18:59.694 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 DDDD 2026-02-17T08:18:59.694 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:78: rados_put_get: rados --pool pool-jerasure put SOMETHING td/test-erasure-code/ORIGINAL 2026-02-17T08:18:59.715 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:79: rados_put_get: rados --pool pool-jerasure get SOMETHING td/test-erasure-code/COPY 2026-02-17T08:18:59.734 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:80: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-17T08:18:59.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:81: rados_put_get: rm td/test-erasure-code/COPY 2026-02-17T08:18:59.736 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: get_osds pool-jerasure SOMETHING 2026-02-17T08:18:59.736 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:18:59.736 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=SOMETHING 2026-02-17T08:18:59.737 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure SOMETHING 2026-02-17T08:18:59.737 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:18:59.929 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=5 2026-02-17T08:18:59.929 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:18:59.929 INFO:tasks.workunit.client.0.trial059.stderr:9 2026-02-17T08:18:59.929 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:18:59.929 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:18:59.929 INFO:tasks.workunit.client.0.trial059.stderr:10' 2026-02-17T08:18:59.929 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 5 1 9 4 3 10 2026-02-17T08:18:59.929 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: initial_osds=('5' '1' '9' '4' '3' '10') 2026-02-17T08:18:59.929 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: local -a initial_osds 2026-02-17T08:18:59.929 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:89: rados_put_get: local last=5 2026-02-17T08:18:59.929 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:90: rados_put_get: ceph osd out 10 2026-02-17T08:19:00.184 INFO:tasks.workunit.client.0.trial059.stderr:osd.10 is already out. 2026-02-17T08:19:00.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:93: rados_put_get: sleep 5 2026-02-17T08:19:05.197 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: get_osds pool-jerasure SOMETHING 2026-02-17T08:19:05.198 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:19:05.198 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=SOMETHING 2026-02-17T08:19:05.198 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: grep '\<10\>' 2026-02-17T08:19:05.198 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure SOMETHING 2026-02-17T08:19:05.198 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:19:05.398 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=5 2026-02-17T08:19:05.398 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:19:05.398 INFO:tasks.workunit.client.0.trial059.stderr:9 2026-02-17T08:19:05.398 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:19:05.398 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:19:05.398 INFO:tasks.workunit.client.0.trial059.stderr:6' 2026-02-17T08:19:05.398 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 5 1 9 4 3 6 2026-02-17T08:19:05.399 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:96: rados_put_get: rados --pool pool-jerasure get SOMETHING td/test-erasure-code/COPY 2026-02-17T08:19:05.416 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:97: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-17T08:19:05.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:98: rados_put_get: ceph osd in 10 2026-02-17T08:19:05.671 INFO:tasks.workunit.client.0.trial059.stderr:osd.10 is already in. 2026-02-17T08:19:05.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:100: rados_put_get: rm td/test-erasure-code/ORIGINAL 2026-02-17T08:19:05.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:227: TEST_rados_put_get_jerasure: rados_osds_out_in td/test-erasure-code pool-jerasure 2026-02-17T08:19:05.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:104: rados_osds_out_in: local dir=td/test-erasure-code 2026-02-17T08:19:05.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:105: rados_osds_out_in: local poolname=pool-jerasure 2026-02-17T08:19:05.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:106: rados_osds_out_in: local objname=SOMETHING 2026-02-17T08:19:05.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:109: rados_osds_out_in: for marker in FFFF GGGG HHHH IIII 2026-02-17T08:19:05.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:110: rados_osds_out_in: printf '%*s' 1024 FFFF 2026-02-17T08:19:05.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:109: rados_osds_out_in: for marker in FFFF GGGG HHHH IIII 2026-02-17T08:19:05.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:110: rados_osds_out_in: printf '%*s' 1024 GGGG 2026-02-17T08:19:05.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:109: rados_osds_out_in: for marker in FFFF GGGG HHHH IIII 2026-02-17T08:19:05.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:110: rados_osds_out_in: printf '%*s' 1024 HHHH 2026-02-17T08:19:05.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:109: rados_osds_out_in: for marker in FFFF GGGG HHHH IIII 2026-02-17T08:19:05.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:110: rados_osds_out_in: printf '%*s' 1024 IIII 2026-02-17T08:19:05.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:116: rados_osds_out_in: rados --pool pool-jerasure put SOMETHING td/test-erasure-code/ORIGINAL 2026-02-17T08:19:05.820 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:117: rados_osds_out_in: rados --pool pool-jerasure get SOMETHING td/test-erasure-code/COPY 2026-02-17T08:19:05.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:118: rados_osds_out_in: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-17T08:19:05.841 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:119: rados_osds_out_in: rm td/test-erasure-code/COPY 2026-02-17T08:19:05.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:127: rados_osds_out_in: wait_for_clean 2026-02-17T08:19:05.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:19:05.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:19:05.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:19:05.843 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:19:05.843 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:19:05.843 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:19:05.844 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:19:05.844 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:19:05.844 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:19:05.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:19:05.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:19:05.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:19:05.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:19:05.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:19:05.949 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:19:06.145 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:19:06.146 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:19:06.146 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:19:06.146 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:19:06.146 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:19:06.146 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:19:06.146 INFO:tasks.workunit.client.0.trial059.stderr:6 2026-02-17T08:19:06.146 INFO:tasks.workunit.client.0.trial059.stderr:7 2026-02-17T08:19:06.146 INFO:tasks.workunit.client.0.trial059.stderr:8 2026-02-17T08:19:06.146 INFO:tasks.workunit.client.0.trial059.stderr:9 2026-02-17T08:19:06.146 INFO:tasks.workunit.client.0.trial059.stderr:10' 2026-02-17T08:19:06.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:19:06.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:06.146 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:19:06.221 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836531 2026-02-17T08:19:06.222 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836531 2026-02-17T08:19:06.222 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836531' 2026-02-17T08:19:06.222 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:06.222 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:19:06.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705713 2026-02-17T08:19:06.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705713 2026-02-17T08:19:06.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836531 1-38654705713' 2026-02-17T08:19:06.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:06.299 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:19:06.373 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=55834574896 2026-02-17T08:19:06.373 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 55834574896 2026-02-17T08:19:06.373 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836531 1-38654705713 2-55834574896' 2026-02-17T08:19:06.373 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:06.373 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:19:06.449 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=296352743448 2026-02-17T08:19:06.449 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 296352743448 2026-02-17T08:19:06.449 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836531 1-38654705713 2-55834574896 3-296352743448' 2026-02-17T08:19:06.449 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:06.449 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:19:06.522 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=94489280556 2026-02-17T08:19:06.522 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 94489280556 2026-02-17T08:19:06.522 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836531 1-38654705713 2-55834574896 3-296352743448 4-94489280556' 2026-02-17T08:19:06.522 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:06.522 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-17T08:19:06.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=326417514516 2026-02-17T08:19:06.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 326417514516 2026-02-17T08:19:06.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836531 1-38654705713 2-55834574896 3-296352743448 4-94489280556 5-326417514516' 2026-02-17T08:19:06.599 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:06.599 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-17T08:19:06.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=377957122063 2026-02-17T08:19:06.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 377957122063 2026-02-17T08:19:06.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836531 1-38654705713 2-55834574896 3-296352743448 4-94489280556 5-326417514516 6-377957122063' 2026-02-17T08:19:06.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:06.672 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-17T08:19:06.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=150323855398 2026-02-17T08:19:06.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 150323855398 2026-02-17T08:19:06.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836531 1-38654705713 2-55834574896 3-296352743448 4-94489280556 5-326417514516 6-377957122063 7-150323855398' 2026-02-17T08:19:06.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:06.747 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-17T08:19:06.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=167503724581 2026-02-17T08:19:06.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 167503724581 2026-02-17T08:19:06.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836531 1-38654705713 2-55834574896 3-296352743448 4-94489280556 5-326417514516 6-377957122063 7-150323855398 8-167503724581' 2026-02-17T08:19:06.824 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:06.824 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-17T08:19:06.899 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=403726925834 2026-02-17T08:19:06.899 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 403726925834 2026-02-17T08:19:06.899 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836531 1-38654705713 2-55834574896 3-296352743448 4-94489280556 5-326417514516 6-377957122063 7-150323855398 8-167503724581 9-403726925834' 2026-02-17T08:19:06.899 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:06.899 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-17T08:19:06.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=201863462945 2026-02-17T08:19:06.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 201863462945 2026-02-17T08:19:06.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836531 1-38654705713 2-55834574896 3-296352743448 4-94489280556 5-326417514516 6-377957122063 7-150323855398 8-167503724581 9-403726925834 10-201863462945' 2026-02-17T08:19:06.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:06.975 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836531 2026-02-17T08:19:06.975 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:06.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:19:06.977 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836531 2026-02-17T08:19:06.977 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:06.978 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836531 2026-02-17T08:19:06.978 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 21474836531 2026-02-17T08:19:06.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836531' 2026-02-17T08:19:06.979 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:19:07.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836529 -lt 21474836531 2026-02-17T08:19:07.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:19:08.181 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:19:08.181 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:19:08.376 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836531 -lt 21474836531 2026-02-17T08:19:08.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:08.377 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705713 2026-02-17T08:19:08.377 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:08.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:19:08.379 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705713 2026-02-17T08:19:08.380 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:08.381 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705713 2026-02-17T08:19:08.381 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705713' 2026-02-17T08:19:08.381 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 38654705713 2026-02-17T08:19:08.382 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:19:08.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705713 -lt 38654705713 2026-02-17T08:19:08.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:08.573 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-55834574896 2026-02-17T08:19:08.573 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:08.574 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:19:08.575 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-55834574896 2026-02-17T08:19:08.575 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:08.576 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=55834574896 2026-02-17T08:19:08.577 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 55834574896' 2026-02-17T08:19:08.577 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 55834574896 2026-02-17T08:19:08.577 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:19:08.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 55834574896 -lt 55834574896 2026-02-17T08:19:08.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:08.779 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-296352743448 2026-02-17T08:19:08.779 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:08.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:19:08.781 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-296352743448 2026-02-17T08:19:08.781 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:08.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=296352743448 2026-02-17T08:19:08.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 296352743448' 2026-02-17T08:19:08.783 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 296352743448 2026-02-17T08:19:08.784 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:19:08.987 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 296352743449 -lt 296352743448 2026-02-17T08:19:08.987 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:08.988 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-94489280556 2026-02-17T08:19:08.988 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:08.989 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:19:08.990 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-94489280556 2026-02-17T08:19:08.990 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:08.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=94489280556 2026-02-17T08:19:08.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 94489280556' 2026-02-17T08:19:08.992 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.4 seq 94489280556 2026-02-17T08:19:08.992 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:19:09.200 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 94489280556 -lt 94489280556 2026-02-17T08:19:09.200 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:09.201 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 5-326417514516 2026-02-17T08:19:09.201 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:09.202 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=5 2026-02-17T08:19:09.203 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 5-326417514516 2026-02-17T08:19:09.203 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:09.205 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=326417514516 2026-02-17T08:19:09.205 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.5 seq 326417514516' 2026-02-17T08:19:09.205 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.5 seq 326417514516 2026-02-17T08:19:09.206 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T08:19:09.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 326417514516 -lt 326417514516 2026-02-17T08:19:09.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:09.403 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 6-377957122063 2026-02-17T08:19:09.404 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:09.404 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=6 2026-02-17T08:19:09.405 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 6-377957122063 2026-02-17T08:19:09.406 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:09.407 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=377957122063 2026-02-17T08:19:09.407 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.6 seq 377957122063' 2026-02-17T08:19:09.407 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.6 seq 377957122063 2026-02-17T08:19:09.408 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T08:19:09.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 377957122063 -lt 377957122063 2026-02-17T08:19:09.617 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:09.617 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 7-150323855398 2026-02-17T08:19:09.617 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:09.618 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=7 2026-02-17T08:19:09.619 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 7-150323855398 2026-02-17T08:19:09.620 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:09.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=150323855398 2026-02-17T08:19:09.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.7 seq 150323855398' 2026-02-17T08:19:09.621 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.7 seq 150323855398 2026-02-17T08:19:09.621 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T08:19:09.815 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 150323855399 -lt 150323855398 2026-02-17T08:19:09.815 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:09.816 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 8-167503724581 2026-02-17T08:19:09.816 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:09.817 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=8 2026-02-17T08:19:09.818 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 8-167503724581 2026-02-17T08:19:09.818 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:09.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=167503724581 2026-02-17T08:19:09.819 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.8 seq 167503724581 2026-02-17T08:19:09.820 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.8 seq 167503724581' 2026-02-17T08:19:09.820 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T08:19:10.013 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 167503724581 -lt 167503724581 2026-02-17T08:19:10.014 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:10.014 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 9-403726925834 2026-02-17T08:19:10.015 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:10.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=9 2026-02-17T08:19:10.016 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 9-403726925834 2026-02-17T08:19:10.016 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:10.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=403726925834 2026-02-17T08:19:10.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.9 seq 403726925834' 2026-02-17T08:19:10.017 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.9 seq 403726925834 2026-02-17T08:19:10.018 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T08:19:10.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 403726925835 -lt 403726925834 2026-02-17T08:19:10.214 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:10.214 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 10-201863462945 2026-02-17T08:19:10.214 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:10.215 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=10 2026-02-17T08:19:10.216 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 10-201863462945 2026-02-17T08:19:10.216 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:10.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=201863462945 2026-02-17T08:19:10.217 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.10 seq 201863462945 2026-02-17T08:19:10.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.10 seq 201863462945' 2026-02-17T08:19:10.218 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-17T08:19:10.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 201863462946 -lt 201863462945 2026-02-17T08:19:10.428 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:19:10.429 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:19:10.429 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:19:10.692 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 28 == 0 2026-02-17T08:19:10.693 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:19:10.693 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:19:10.693 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:19:10.693 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:19:10.693 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:19:10.693 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:19:10.693 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:19:10.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=28 2026-02-17T08:19:10.890 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:19:10.890 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:19:10.890 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:19:11.153 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 28 = 28 2026-02-17T08:19:11.153 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:19:11.153 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:19:11.154 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:128: rados_osds_out_in: get_osds pool-jerasure SOMETHING 2026-02-17T08:19:11.154 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:19:11.154 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=SOMETHING 2026-02-17T08:19:11.154 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure SOMETHING 2026-02-17T08:19:11.154 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:19:11.350 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=5 2026-02-17T08:19:11.350 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:19:11.350 INFO:tasks.workunit.client.0.trial059.stderr:9 2026-02-17T08:19:11.350 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:19:11.350 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:19:11.350 INFO:tasks.workunit.client.0.trial059.stderr:10' 2026-02-17T08:19:11.351 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 5 1 9 4 3 10 2026-02-17T08:19:11.351 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:128: rados_osds_out_in: local 'osds_list=5 1 9 4 3 10' 2026-02-17T08:19:11.351 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:129: rados_osds_out_in: osds=('5' '1' '9' '4' '3' '10') 2026-02-17T08:19:11.351 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:129: rados_osds_out_in: local -a osds 2026-02-17T08:19:11.351 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:130: rados_osds_out_in: for osd in 0 1 2026-02-17T08:19:11.351 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:131: rados_osds_out_in: ceph osd out 5 2026-02-17T08:19:11.573 INFO:tasks.workunit.client.0.trial059.stderr:osd.5 is already out. 2026-02-17T08:19:11.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:130: rados_osds_out_in: for osd in 0 1 2026-02-17T08:19:11.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:131: rados_osds_out_in: ceph osd out 1 2026-02-17T08:19:11.878 INFO:tasks.workunit.client.0.trial059.stderr:osd.1 is already out. 2026-02-17T08:19:11.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:133: rados_osds_out_in: wait_for_clean 2026-02-17T08:19:11.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:19:11.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:19:11.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:19:11.889 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:19:11.889 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:19:11.889 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:19:11.890 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:19:11.890 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:19:11.890 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:19:11.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:19:11.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:19:11.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:19:11.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:19:11.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:19:11.994 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:19:12.198 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:19:12.198 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:19:12.198 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:19:12.198 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:19:12.198 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:19:12.199 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:19:12.199 INFO:tasks.workunit.client.0.trial059.stderr:6 2026-02-17T08:19:12.199 INFO:tasks.workunit.client.0.trial059.stderr:7 2026-02-17T08:19:12.199 INFO:tasks.workunit.client.0.trial059.stderr:8 2026-02-17T08:19:12.199 INFO:tasks.workunit.client.0.trial059.stderr:9 2026-02-17T08:19:12.199 INFO:tasks.workunit.client.0.trial059.stderr:10' 2026-02-17T08:19:12.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:19:12.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:12.199 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:19:12.273 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836534 2026-02-17T08:19:12.273 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836534 2026-02-17T08:19:12.273 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836534' 2026-02-17T08:19:12.274 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:12.274 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:19:12.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705716 2026-02-17T08:19:12.348 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705716 2026-02-17T08:19:12.348 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836534 1-38654705716' 2026-02-17T08:19:12.348 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:12.348 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:19:12.421 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=55834574899 2026-02-17T08:19:12.421 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 55834574899 2026-02-17T08:19:12.421 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836534 1-38654705716 2-55834574899' 2026-02-17T08:19:12.421 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:12.421 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:19:12.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=296352743452 2026-02-17T08:19:12.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 296352743452 2026-02-17T08:19:12.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836534 1-38654705716 2-55834574899 3-296352743452' 2026-02-17T08:19:12.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:12.499 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:19:12.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=94489280559 2026-02-17T08:19:12.576 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 94489280559 2026-02-17T08:19:12.576 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836534 1-38654705716 2-55834574899 3-296352743452 4-94489280559' 2026-02-17T08:19:12.576 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:12.576 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-17T08:19:12.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=326417514519 2026-02-17T08:19:12.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 326417514519 2026-02-17T08:19:12.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836534 1-38654705716 2-55834574899 3-296352743452 4-94489280559 5-326417514519' 2026-02-17T08:19:12.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:12.650 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-17T08:19:12.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=377957122066 2026-02-17T08:19:12.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 377957122066 2026-02-17T08:19:12.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836534 1-38654705716 2-55834574899 3-296352743452 4-94489280559 5-326417514519 6-377957122066' 2026-02-17T08:19:12.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:12.726 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-17T08:19:12.801 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=150323855402 2026-02-17T08:19:12.801 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 150323855402 2026-02-17T08:19:12.801 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836534 1-38654705716 2-55834574899 3-296352743452 4-94489280559 5-326417514519 6-377957122066 7-150323855402' 2026-02-17T08:19:12.802 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:12.802 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-17T08:19:12.877 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=167503724584 2026-02-17T08:19:12.877 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 167503724584 2026-02-17T08:19:12.877 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836534 1-38654705716 2-55834574899 3-296352743452 4-94489280559 5-326417514519 6-377957122066 7-150323855402 8-167503724584' 2026-02-17T08:19:12.877 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:12.877 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-17T08:19:12.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=403726925838 2026-02-17T08:19:12.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 403726925838 2026-02-17T08:19:12.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836534 1-38654705716 2-55834574899 3-296352743452 4-94489280559 5-326417514519 6-377957122066 7-150323855402 8-167503724584 9-403726925838' 2026-02-17T08:19:12.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:12.954 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-17T08:19:13.029 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=201863462948 2026-02-17T08:19:13.029 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 201863462948 2026-02-17T08:19:13.029 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836534 1-38654705716 2-55834574899 3-296352743452 4-94489280559 5-326417514519 6-377957122066 7-150323855402 8-167503724584 9-403726925838 10-201863462948' 2026-02-17T08:19:13.029 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:13.030 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836534 2026-02-17T08:19:13.030 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:13.031 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:19:13.032 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836534 2026-02-17T08:19:13.032 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:13.033 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836534 2026-02-17T08:19:13.033 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 21474836534 2026-02-17T08:19:13.033 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836534' 2026-02-17T08:19:13.033 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:19:13.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836532 -lt 21474836534 2026-02-17T08:19:13.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:19:14.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:19:14.226 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:19:14.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836534 -lt 21474836534 2026-02-17T08:19:14.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:14.427 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705716 2026-02-17T08:19:14.427 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:14.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:19:14.429 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705716 2026-02-17T08:19:14.430 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:14.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705716 2026-02-17T08:19:14.431 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 38654705716 2026-02-17T08:19:14.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705716' 2026-02-17T08:19:14.432 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:19:14.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705717 -lt 38654705716 2026-02-17T08:19:14.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:14.634 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-55834574899 2026-02-17T08:19:14.634 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:14.635 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:19:14.636 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-55834574899 2026-02-17T08:19:14.636 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:14.637 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=55834574899 2026-02-17T08:19:14.638 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 55834574899 2026-02-17T08:19:14.638 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 55834574899' 2026-02-17T08:19:14.638 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:19:14.846 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 55834574900 -lt 55834574899 2026-02-17T08:19:14.846 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:14.847 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-296352743452 2026-02-17T08:19:14.847 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:14.848 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:19:14.849 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-296352743452 2026-02-17T08:19:14.849 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:14.850 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=296352743452 2026-02-17T08:19:14.850 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 296352743452 2026-02-17T08:19:14.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 296352743452' 2026-02-17T08:19:14.851 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:19:15.055 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 296352743452 -lt 296352743452 2026-02-17T08:19:15.055 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:15.056 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-94489280559 2026-02-17T08:19:15.056 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:15.057 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:19:15.058 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-94489280559 2026-02-17T08:19:15.058 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:15.059 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=94489280559 2026-02-17T08:19:15.060 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.4 seq 94489280559 2026-02-17T08:19:15.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 94489280559' 2026-02-17T08:19:15.060 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:19:15.262 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 94489280559 -lt 94489280559 2026-02-17T08:19:15.262 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:15.263 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 5-326417514519 2026-02-17T08:19:15.263 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:15.265 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=5 2026-02-17T08:19:15.265 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 5-326417514519 2026-02-17T08:19:15.266 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:15.267 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=326417514519 2026-02-17T08:19:15.267 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.5 seq 326417514519 2026-02-17T08:19:15.268 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.5 seq 326417514519' 2026-02-17T08:19:15.268 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T08:19:15.466 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 326417514519 -lt 326417514519 2026-02-17T08:19:15.467 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:15.467 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 6-377957122066 2026-02-17T08:19:15.467 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:15.468 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=6 2026-02-17T08:19:15.469 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 6-377957122066 2026-02-17T08:19:15.470 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:15.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=377957122066 2026-02-17T08:19:15.471 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.6 seq 377957122066 2026-02-17T08:19:15.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.6 seq 377957122066' 2026-02-17T08:19:15.471 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T08:19:15.676 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 377957122066 -lt 377957122066 2026-02-17T08:19:15.676 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:15.677 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 7-150323855402 2026-02-17T08:19:15.677 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:15.678 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=7 2026-02-17T08:19:15.679 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 7-150323855402 2026-02-17T08:19:15.679 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:15.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=150323855402 2026-02-17T08:19:15.681 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.7 seq 150323855402 2026-02-17T08:19:15.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.7 seq 150323855402' 2026-02-17T08:19:15.681 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T08:19:15.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 150323855402 -lt 150323855402 2026-02-17T08:19:15.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:15.886 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 8-167503724584 2026-02-17T08:19:15.886 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:15.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=8 2026-02-17T08:19:15.888 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 8-167503724584 2026-02-17T08:19:15.888 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:15.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=167503724584 2026-02-17T08:19:15.889 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.8 seq 167503724584 2026-02-17T08:19:15.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.8 seq 167503724584' 2026-02-17T08:19:15.890 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T08:19:16.081 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 167503724584 -lt 167503724584 2026-02-17T08:19:16.082 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:16.082 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 9-403726925838 2026-02-17T08:19:16.082 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:16.083 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=9 2026-02-17T08:19:16.084 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 9-403726925838 2026-02-17T08:19:16.084 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:16.085 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=403726925838 2026-02-17T08:19:16.085 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.9 seq 403726925838 2026-02-17T08:19:16.086 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.9 seq 403726925838' 2026-02-17T08:19:16.086 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T08:19:16.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 403726925838 -lt 403726925838 2026-02-17T08:19:16.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:16.288 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 10-201863462948 2026-02-17T08:19:16.288 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:16.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=10 2026-02-17T08:19:16.290 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 10-201863462948 2026-02-17T08:19:16.290 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:16.292 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=201863462948 2026-02-17T08:19:16.292 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.10 seq 201863462948 2026-02-17T08:19:16.292 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.10 seq 201863462948' 2026-02-17T08:19:16.292 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-17T08:19:16.489 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 201863462949 -lt 201863462948 2026-02-17T08:19:16.489 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:19:16.490 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:19:16.490 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:19:16.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 28 == 0 2026-02-17T08:19:16.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:19:16.743 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:19:16.743 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:19:16.743 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:19:16.744 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:19:16.744 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:19:16.744 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:19:16.937 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=28 2026-02-17T08:19:16.938 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:19:16.938 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:19:16.938 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:19:17.193 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 28 = 28 2026-02-17T08:19:17.193 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:19:17.193 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:19:17.193 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:137: rados_osds_out_in: for osd in 0 1 2026-02-17T08:19:17.193 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:138: rados_osds_out_in: get_osds pool-jerasure SOMETHING 2026-02-17T08:19:17.193 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:19:17.194 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=SOMETHING 2026-02-17T08:19:17.194 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:138: rados_osds_out_in: grep '\<5\>' 2026-02-17T08:19:17.194 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure SOMETHING 2026-02-17T08:19:17.194 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:19:17.404 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=2 2026-02-17T08:19:17.404 INFO:tasks.workunit.client.0.trial059.stderr:7 2026-02-17T08:19:17.404 INFO:tasks.workunit.client.0.trial059.stderr:9 2026-02-17T08:19:17.404 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:19:17.404 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:19:17.404 INFO:tasks.workunit.client.0.trial059.stderr:10' 2026-02-17T08:19:17.405 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 2 7 9 4 3 10 2026-02-17T08:19:17.405 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:137: rados_osds_out_in: for osd in 0 1 2026-02-17T08:19:17.406 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:138: rados_osds_out_in: get_osds pool-jerasure SOMETHING 2026-02-17T08:19:17.406 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:19:17.406 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=SOMETHING 2026-02-17T08:19:17.406 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:138: rados_osds_out_in: grep '\<1\>' 2026-02-17T08:19:17.406 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure SOMETHING 2026-02-17T08:19:17.406 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:19:17.605 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=2 2026-02-17T08:19:17.605 INFO:tasks.workunit.client.0.trial059.stderr:7 2026-02-17T08:19:17.605 INFO:tasks.workunit.client.0.trial059.stderr:9 2026-02-17T08:19:17.605 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:19:17.605 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:19:17.605 INFO:tasks.workunit.client.0.trial059.stderr:10' 2026-02-17T08:19:17.605 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 2 7 9 4 3 10 2026-02-17T08:19:17.605 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:140: rados_osds_out_in: rados --pool pool-jerasure get SOMETHING td/test-erasure-code/COPY 2026-02-17T08:19:17.624 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:141: rados_osds_out_in: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-17T08:19:17.625 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:147: rados_osds_out_in: for osd in 0 1 2026-02-17T08:19:17.625 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:148: rados_osds_out_in: ceph osd in 5 2026-02-17T08:19:17.878 INFO:tasks.workunit.client.0.trial059.stderr:osd.5 is already in. 2026-02-17T08:19:17.888 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:147: rados_osds_out_in: for osd in 0 1 2026-02-17T08:19:17.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:148: rados_osds_out_in: ceph osd in 1 2026-02-17T08:19:18.185 INFO:tasks.workunit.client.0.trial059.stderr:osd.1 is already in. 2026-02-17T08:19:18.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:150: rados_osds_out_in: wait_for_clean 2026-02-17T08:19:18.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:19:18.196 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:19:18.196 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:19:18.196 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:19:18.196 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:19:18.196 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:19:18.197 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:19:18.197 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:19:18.197 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:19:18.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:19:18.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:19:18.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:19:18.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:19:18.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:19:18.301 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:19:18.503 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:19:18.503 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:19:18.504 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:19:18.504 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:19:18.504 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:19:18.504 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:19:18.504 INFO:tasks.workunit.client.0.trial059.stderr:6 2026-02-17T08:19:18.504 INFO:tasks.workunit.client.0.trial059.stderr:7 2026-02-17T08:19:18.504 INFO:tasks.workunit.client.0.trial059.stderr:8 2026-02-17T08:19:18.504 INFO:tasks.workunit.client.0.trial059.stderr:9 2026-02-17T08:19:18.504 INFO:tasks.workunit.client.0.trial059.stderr:10' 2026-02-17T08:19:18.504 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:19:18.505 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:18.505 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:19:18.577 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836537 2026-02-17T08:19:18.577 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836537 2026-02-17T08:19:18.577 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836537' 2026-02-17T08:19:18.577 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:18.578 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:19:18.654 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705719 2026-02-17T08:19:18.654 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705719 2026-02-17T08:19:18.654 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836537 1-38654705719' 2026-02-17T08:19:18.654 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:18.654 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:19:18.729 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=55834574903 2026-02-17T08:19:18.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 55834574903 2026-02-17T08:19:18.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836537 1-38654705719 2-55834574903' 2026-02-17T08:19:18.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:18.730 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:19:18.803 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=296352743455 2026-02-17T08:19:18.803 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 296352743455 2026-02-17T08:19:18.804 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836537 1-38654705719 2-55834574903 3-296352743455' 2026-02-17T08:19:18.804 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:18.804 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:19:18.880 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=94489280562 2026-02-17T08:19:18.880 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 94489280562 2026-02-17T08:19:18.880 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836537 1-38654705719 2-55834574903 3-296352743455 4-94489280562' 2026-02-17T08:19:18.880 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:18.880 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-17T08:19:18.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=326417514522 2026-02-17T08:19:18.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 326417514522 2026-02-17T08:19:18.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836537 1-38654705719 2-55834574903 3-296352743455 4-94489280562 5-326417514522' 2026-02-17T08:19:18.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:18.954 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-17T08:19:19.033 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=377957122069 2026-02-17T08:19:19.033 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 377957122069 2026-02-17T08:19:19.033 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836537 1-38654705719 2-55834574903 3-296352743455 4-94489280562 5-326417514522 6-377957122069' 2026-02-17T08:19:19.033 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:19.033 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-17T08:19:19.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=150323855405 2026-02-17T08:19:19.110 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 150323855405 2026-02-17T08:19:19.110 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836537 1-38654705719 2-55834574903 3-296352743455 4-94489280562 5-326417514522 6-377957122069 7-150323855405' 2026-02-17T08:19:19.110 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:19.110 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-17T08:19:19.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=167503724587 2026-02-17T08:19:19.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 167503724587 2026-02-17T08:19:19.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836537 1-38654705719 2-55834574903 3-296352743455 4-94489280562 5-326417514522 6-377957122069 7-150323855405 8-167503724587' 2026-02-17T08:19:19.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:19.186 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2026-02-17T08:19:19.262 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=403726925841 2026-02-17T08:19:19.262 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 403726925841 2026-02-17T08:19:19.262 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836537 1-38654705719 2-55834574903 3-296352743455 4-94489280562 5-326417514522 6-377957122069 7-150323855405 8-167503724587 9-403726925841' 2026-02-17T08:19:19.263 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:19:19.263 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2026-02-17T08:19:19.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=201863462952 2026-02-17T08:19:19.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 201863462952 2026-02-17T08:19:19.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836537 1-38654705719 2-55834574903 3-296352743455 4-94489280562 5-326417514522 6-377957122069 7-150323855405 8-167503724587 9-403726925841 10-201863462952' 2026-02-17T08:19:19.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:19.339 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836537 2026-02-17T08:19:19.339 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:19.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:19:19.340 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836537 2026-02-17T08:19:19.340 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:19.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836537 2026-02-17T08:19:19.342 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836537' 2026-02-17T08:19:19.342 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 21474836537 2026-02-17T08:19:19.342 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:19:19.538 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836535 -lt 21474836537 2026-02-17T08:19:19.538 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:19:20.539 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:19:20.540 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:19:20.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836538 -lt 21474836537 2026-02-17T08:19:20.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:20.741 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705719 2026-02-17T08:19:20.741 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:20.742 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:19:20.742 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705719 2026-02-17T08:19:20.743 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:20.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705719 2026-02-17T08:19:20.744 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 38654705719 2026-02-17T08:19:20.745 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705719' 2026-02-17T08:19:20.745 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:19:20.955 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705720 -lt 38654705719 2026-02-17T08:19:20.955 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:20.956 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-55834574903 2026-02-17T08:19:20.956 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:20.957 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:19:20.958 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-55834574903 2026-02-17T08:19:20.958 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:20.959 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=55834574903 2026-02-17T08:19:20.960 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 55834574903' 2026-02-17T08:19:20.960 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 55834574903 2026-02-17T08:19:20.960 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:19:21.170 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 55834574903 -lt 55834574903 2026-02-17T08:19:21.170 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:21.170 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-296352743455 2026-02-17T08:19:21.170 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:21.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:19:21.172 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-296352743455 2026-02-17T08:19:21.173 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:21.174 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=296352743455 2026-02-17T08:19:21.174 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 296352743455 2026-02-17T08:19:21.174 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 296352743455' 2026-02-17T08:19:21.175 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:19:21.369 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 296352743455 -lt 296352743455 2026-02-17T08:19:21.369 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:21.370 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-94489280562 2026-02-17T08:19:21.370 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:21.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:19:21.372 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-94489280562 2026-02-17T08:19:21.372 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:21.374 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=94489280562 2026-02-17T08:19:21.374 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.4 seq 94489280562 2026-02-17T08:19:21.374 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 94489280562' 2026-02-17T08:19:21.374 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:19:21.581 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 94489280562 -lt 94489280562 2026-02-17T08:19:21.581 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:21.582 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 5-326417514522 2026-02-17T08:19:21.582 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:21.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=5 2026-02-17T08:19:21.584 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 5-326417514522 2026-02-17T08:19:21.585 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:21.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=326417514522 2026-02-17T08:19:21.586 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.5 seq 326417514522 2026-02-17T08:19:21.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.5 seq 326417514522' 2026-02-17T08:19:21.586 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T08:19:21.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 326417514523 -lt 326417514522 2026-02-17T08:19:21.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:21.788 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 6-377957122069 2026-02-17T08:19:21.788 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:21.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=6 2026-02-17T08:19:21.790 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 6-377957122069 2026-02-17T08:19:21.790 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:21.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=377957122069 2026-02-17T08:19:21.791 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.6 seq 377957122069 2026-02-17T08:19:21.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.6 seq 377957122069' 2026-02-17T08:19:21.792 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T08:19:21.999 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 377957122070 -lt 377957122069 2026-02-17T08:19:21.999 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:22.000 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 7-150323855405 2026-02-17T08:19:22.000 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:22.001 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=7 2026-02-17T08:19:22.002 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 7-150323855405 2026-02-17T08:19:22.002 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:22.003 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=150323855405 2026-02-17T08:19:22.003 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.7 seq 150323855405 2026-02-17T08:19:22.004 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.7 seq 150323855405' 2026-02-17T08:19:22.004 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T08:19:22.211 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 150323855406 -lt 150323855405 2026-02-17T08:19:22.211 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:22.212 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 8-167503724587 2026-02-17T08:19:22.212 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:22.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=8 2026-02-17T08:19:22.214 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 8-167503724587 2026-02-17T08:19:22.214 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:22.215 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=167503724587 2026-02-17T08:19:22.215 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.8 seq 167503724587' 2026-02-17T08:19:22.215 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.8 seq 167503724587 2026-02-17T08:19:22.216 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T08:19:22.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 167503724588 -lt 167503724587 2026-02-17T08:19:22.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:22.418 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 9-403726925841 2026-02-17T08:19:22.418 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:22.419 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=9 2026-02-17T08:19:22.420 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 9-403726925841 2026-02-17T08:19:22.420 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:22.421 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=403726925841 2026-02-17T08:19:22.421 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.9 seq 403726925841' 2026-02-17T08:19:22.422 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.9 seq 403726925841 2026-02-17T08:19:22.422 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T08:19:22.623 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 403726925841 -lt 403726925841 2026-02-17T08:19:22.623 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:19:22.623 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 10-201863462952 2026-02-17T08:19:22.624 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:19:22.625 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=10 2026-02-17T08:19:22.625 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 10-201863462952 2026-02-17T08:19:22.626 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:19:22.627 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=201863462952 2026-02-17T08:19:22.627 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.10 seq 201863462952 2026-02-17T08:19:22.627 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.10 seq 201863462952' 2026-02-17T08:19:22.628 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 10 2026-02-17T08:19:22.828 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 201863462952 -lt 201863462952 2026-02-17T08:19:22.828 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:19:22.829 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:19:22.829 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:19:23.079 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 28 == 0 2026-02-17T08:19:23.080 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:19:23.080 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:19:23.080 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:19:23.080 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:19:23.080 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:19:23.080 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:19:23.080 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:19:23.276 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=28 2026-02-17T08:19:23.276 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:19:23.277 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:19:23.277 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:19:23.536 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 28 = 28 2026-02-17T08:19:23.536 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:19:23.536 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:19:23.537 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:151: rados_osds_out_in: get_osds pool-jerasure SOMETHING 2026-02-17T08:19:23.537 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:19:23.537 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=SOMETHING 2026-02-17T08:19:23.537 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure SOMETHING 2026-02-17T08:19:23.537 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:19:23.737 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=5 2026-02-17T08:19:23.737 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:19:23.737 INFO:tasks.workunit.client.0.trial059.stderr:9 2026-02-17T08:19:23.737 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:19:23.737 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:19:23.737 INFO:tasks.workunit.client.0.trial059.stderr:10' 2026-02-17T08:19:23.738 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 5 1 9 4 3 10 2026-02-17T08:19:23.738 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:151: rados_osds_out_in: test '5 1 9 4 3 10' = '5 1 9 4 3 10' 2026-02-17T08:19:23.738 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:152: rados_osds_out_in: rm td/test-erasure-code/ORIGINAL 2026-02-17T08:19:23.739 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:229: TEST_rados_put_get_jerasure: delete_pool pool-jerasure 2026-02-17T08:19:23.739 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=pool-jerasure 2026-02-17T08:19:23.739 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-17T08:19:23.948 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' does not exist 2026-02-17T08:19:23.957 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:230: TEST_rados_put_get_jerasure: ceph osd erasure-code-profile rm profile-jerasure 2026-02-17T08:19:24.258 INFO:tasks.workunit.client.0.trial059.stderr:erasure-code-profile profile-jerasure does not exist 2026-02-17T08:19:24.269 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:47: run: for func in $funcs 2026-02-17T08:19:24.270 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:48: run: TEST_rados_put_get_lrc_advanced td/test-erasure-code 2026-02-17T08:19:24.270 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:156: TEST_rados_put_get_lrc_advanced: local dir=td/test-erasure-code 2026-02-17T08:19:24.270 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:157: TEST_rados_put_get_lrc_advanced: local poolname=pool-lrc-a 2026-02-17T08:19:24.270 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:158: TEST_rados_put_get_lrc_advanced: local profile=profile-lrc-a 2026-02-17T08:19:24.270 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:160: TEST_rados_put_get_lrc_advanced: ceph osd erasure-code-profile set profile-lrc-a plugin=lrc mapping=DD_ 'crush-steps=[ [ "chooseleaf", "osd", 0 ] ]' 'layers=[ [ "DDc", "" ] ]' 2026-02-17T08:19:24.526 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:165: TEST_rados_put_get_lrc_advanced: create_pool pool-lrc-a 12 12 erasure profile-lrc-a 2026-02-17T08:19:24.527 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create pool-lrc-a 12 12 erasure profile-lrc-a 2026-02-17T08:19:24.883 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-lrc-a' already exists 2026-02-17T08:19:24.894 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:19:25.896 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:168: TEST_rados_put_get_lrc_advanced: rados_put_get td/test-erasure-code pool-lrc-a 2026-02-17T08:19:25.896 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:66: rados_put_get: local dir=td/test-erasure-code 2026-02-17T08:19:25.896 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:67: rados_put_get: local poolname=pool-lrc-a 2026-02-17T08:19:25.897 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:68: rados_put_get: local objname=SOMETHING 2026-02-17T08:19:25.897 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-17T08:19:25.897 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 AAA 2026-02-17T08:19:25.897 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-17T08:19:25.897 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 BBB 2026-02-17T08:19:25.897 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-17T08:19:25.897 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 CCCC 2026-02-17T08:19:25.897 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-17T08:19:25.897 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 DDDD 2026-02-17T08:19:25.897 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:78: rados_put_get: rados --pool pool-lrc-a put SOMETHING td/test-erasure-code/ORIGINAL 2026-02-17T08:19:25.915 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:79: rados_put_get: rados --pool pool-lrc-a get SOMETHING td/test-erasure-code/COPY 2026-02-17T08:19:25.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:80: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-17T08:19:25.941 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:81: rados_put_get: rm td/test-erasure-code/COPY 2026-02-17T08:19:25.943 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: get_osds pool-lrc-a SOMETHING 2026-02-17T08:19:25.943 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-lrc-a 2026-02-17T08:19:25.944 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=SOMETHING 2026-02-17T08:19:25.944 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-lrc-a SOMETHING 2026-02-17T08:19:25.944 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:19:26.145 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=5 2026-02-17T08:19:26.146 INFO:tasks.workunit.client.0.trial059.stderr:9 2026-02-17T08:19:26.146 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:19:26.146 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 5 9 3 2026-02-17T08:19:26.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: initial_osds=('5' '9' '3') 2026-02-17T08:19:26.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: local -a initial_osds 2026-02-17T08:19:26.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:89: rados_put_get: local last=2 2026-02-17T08:19:26.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:90: rados_put_get: ceph osd out 3 2026-02-17T08:19:26.398 INFO:tasks.workunit.client.0.trial059.stderr:osd.3 is already out. 2026-02-17T08:19:26.407 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:93: rados_put_get: sleep 5 2026-02-17T08:19:31.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: get_osds pool-lrc-a SOMETHING 2026-02-17T08:19:31.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-lrc-a 2026-02-17T08:19:31.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=SOMETHING 2026-02-17T08:19:31.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: grep '\<3\>' 2026-02-17T08:19:31.411 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-lrc-a SOMETHING 2026-02-17T08:19:31.411 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:19:31.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=5 2026-02-17T08:19:31.608 INFO:tasks.workunit.client.0.trial059.stderr:9 2026-02-17T08:19:31.608 INFO:tasks.workunit.client.0.trial059.stderr:7' 2026-02-17T08:19:31.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 5 9 7 2026-02-17T08:19:31.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:96: rados_put_get: rados --pool pool-lrc-a get SOMETHING td/test-erasure-code/COPY 2026-02-17T08:19:31.626 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:97: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-17T08:19:31.626 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:98: rados_put_get: ceph osd in 3 2026-02-17T08:19:31.872 INFO:tasks.workunit.client.0.trial059.stderr:osd.3 is already in. 2026-02-17T08:19:31.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:100: rados_put_get: rm td/test-erasure-code/ORIGINAL 2026-02-17T08:19:31.882 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:170: TEST_rados_put_get_lrc_advanced: delete_pool pool-lrc-a 2026-02-17T08:19:31.882 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=pool-lrc-a 2026-02-17T08:19:31.882 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete pool-lrc-a pool-lrc-a --yes-i-really-really-mean-it 2026-02-17T08:19:32.074 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-lrc-a' does not exist 2026-02-17T08:19:32.084 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:171: TEST_rados_put_get_lrc_advanced: ceph osd erasure-code-profile rm profile-lrc-a 2026-02-17T08:19:32.280 INFO:tasks.workunit.client.0.trial059.stderr:erasure-code-profile profile-lrc-a does not exist 2026-02-17T08:19:32.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:47: run: for func in $funcs 2026-02-17T08:19:32.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:48: run: TEST_rados_put_get_lrc_kml td/test-erasure-code 2026-02-17T08:19:32.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:175: TEST_rados_put_get_lrc_kml: local dir=td/test-erasure-code 2026-02-17T08:19:32.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:176: TEST_rados_put_get_lrc_kml: local poolname=pool-lrc 2026-02-17T08:19:32.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:177: TEST_rados_put_get_lrc_kml: local profile=profile-lrc 2026-02-17T08:19:32.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:179: TEST_rados_put_get_lrc_kml: ceph osd erasure-code-profile set profile-lrc plugin=lrc k=4 m=2 l=3 crush-failure-domain=osd 2026-02-17T08:19:32.551 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:183: TEST_rados_put_get_lrc_kml: create_pool pool-lrc 12 12 erasure profile-lrc 2026-02-17T08:19:32.551 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create pool-lrc 12 12 erasure profile-lrc 2026-02-17T08:19:32.907 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-lrc' already exists 2026-02-17T08:19:32.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:19:33.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:186: TEST_rados_put_get_lrc_kml: rados_put_get td/test-erasure-code pool-lrc 2026-02-17T08:19:33.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:66: rados_put_get: local dir=td/test-erasure-code 2026-02-17T08:19:33.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:67: rados_put_get: local poolname=pool-lrc 2026-02-17T08:19:33.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:68: rados_put_get: local objname=SOMETHING 2026-02-17T08:19:33.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-17T08:19:33.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 AAA 2026-02-17T08:19:33.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-17T08:19:33.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 BBB 2026-02-17T08:19:33.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-17T08:19:33.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 CCCC 2026-02-17T08:19:33.920 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-17T08:19:33.920 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 DDDD 2026-02-17T08:19:33.920 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:78: rados_put_get: rados --pool pool-lrc put SOMETHING td/test-erasure-code/ORIGINAL 2026-02-17T08:19:33.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:79: rados_put_get: rados --pool pool-lrc get SOMETHING td/test-erasure-code/COPY 2026-02-17T08:19:33.961 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:80: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-17T08:19:33.962 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:81: rados_put_get: rm td/test-erasure-code/COPY 2026-02-17T08:19:33.963 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: get_osds pool-lrc SOMETHING 2026-02-17T08:19:33.963 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-lrc 2026-02-17T08:19:33.963 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=SOMETHING 2026-02-17T08:19:33.964 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-lrc SOMETHING 2026-02-17T08:19:33.964 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:19:34.158 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=8 2026-02-17T08:19:34.158 INFO:tasks.workunit.client.0.trial059.stderr:6 2026-02-17T08:19:34.158 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:19:34.158 INFO:tasks.workunit.client.0.trial059.stderr:10 2026-02-17T08:19:34.158 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:19:34.158 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:19:34.158 INFO:tasks.workunit.client.0.trial059.stderr:9 2026-02-17T08:19:34.158 INFO:tasks.workunit.client.0.trial059.stderr:7' 2026-02-17T08:19:34.158 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 8 6 0 10 5 3 9 7 2026-02-17T08:19:34.158 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: initial_osds=('8' '6' '0' '10' '5' '3' '9' '7') 2026-02-17T08:19:34.158 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: local -a initial_osds 2026-02-17T08:19:34.158 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:89: rados_put_get: local last=7 2026-02-17T08:19:34.158 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:90: rados_put_get: ceph osd out 7 2026-02-17T08:19:34.396 INFO:tasks.workunit.client.0.trial059.stderr:osd.7 is already out. 2026-02-17T08:19:34.406 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:93: rados_put_get: sleep 5 2026-02-17T08:19:39.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: get_osds pool-lrc SOMETHING 2026-02-17T08:19:39.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-lrc 2026-02-17T08:19:39.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=SOMETHING 2026-02-17T08:19:39.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: grep '\<7\>' 2026-02-17T08:19:39.410 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-lrc SOMETHING 2026-02-17T08:19:39.410 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:19:39.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=8 2026-02-17T08:19:39.606 INFO:tasks.workunit.client.0.trial059.stderr:6 2026-02-17T08:19:39.606 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:19:39.606 INFO:tasks.workunit.client.0.trial059.stderr:10 2026-02-17T08:19:39.606 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:19:39.606 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:19:39.606 INFO:tasks.workunit.client.0.trial059.stderr:9 2026-02-17T08:19:39.606 INFO:tasks.workunit.client.0.trial059.stderr:4' 2026-02-17T08:19:39.607 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 8 6 0 10 5 3 9 4 2026-02-17T08:19:39.607 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:96: rados_put_get: rados --pool pool-lrc get SOMETHING td/test-erasure-code/COPY 2026-02-17T08:19:39.625 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:97: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-17T08:19:39.625 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:98: rados_put_get: ceph osd in 7 2026-02-17T08:19:39.881 INFO:tasks.workunit.client.0.trial059.stderr:osd.7 is already in. 2026-02-17T08:19:39.892 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:100: rados_put_get: rm td/test-erasure-code/ORIGINAL 2026-02-17T08:19:39.893 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:188: TEST_rados_put_get_lrc_kml: delete_pool pool-lrc 2026-02-17T08:19:39.893 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=pool-lrc 2026-02-17T08:19:39.893 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete pool-lrc pool-lrc --yes-i-really-really-mean-it 2026-02-17T08:19:40.181 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-lrc' does not exist 2026-02-17T08:19:40.191 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:189: TEST_rados_put_get_lrc_kml: ceph osd erasure-code-profile rm profile-lrc 2026-02-17T08:19:40.436 INFO:tasks.workunit.client.0.trial059.stderr:erasure-code-profile profile-lrc does not exist 2026-02-17T08:19:40.446 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:47: run: for func in $funcs 2026-02-17T08:19:40.447 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:48: run: TEST_rados_put_get_shec td/test-erasure-code 2026-02-17T08:19:40.447 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:234: TEST_rados_put_get_shec: local dir=td/test-erasure-code 2026-02-17T08:19:40.447 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:236: TEST_rados_put_get_shec: local poolname=pool-shec 2026-02-17T08:19:40.447 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:237: TEST_rados_put_get_shec: local profile=profile-shec 2026-02-17T08:19:40.447 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:239: TEST_rados_put_get_shec: ceph osd erasure-code-profile set profile-shec plugin=shec k=2 m=1 c=1 crush-failure-domain=osd 2026-02-17T08:19:40.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:243: TEST_rados_put_get_shec: create_pool pool-shec 12 12 erasure profile-shec 2026-02-17T08:19:40.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create pool-shec 12 12 erasure profile-shec 2026-02-17T08:19:41.108 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-shec' already exists 2026-02-17T08:19:41.118 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:19:42.121 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:246: TEST_rados_put_get_shec: rados_put_get td/test-erasure-code pool-shec 2026-02-17T08:19:42.121 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:66: rados_put_get: local dir=td/test-erasure-code 2026-02-17T08:19:42.121 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:67: rados_put_get: local poolname=pool-shec 2026-02-17T08:19:42.121 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:68: rados_put_get: local objname=SOMETHING 2026-02-17T08:19:42.121 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-17T08:19:42.121 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 AAA 2026-02-17T08:19:42.121 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-17T08:19:42.121 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 BBB 2026-02-17T08:19:42.121 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-17T08:19:42.121 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 CCCC 2026-02-17T08:19:42.121 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:71: rados_put_get: for marker in AAA BBB CCCC DDDD 2026-02-17T08:19:42.121 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:72: rados_put_get: printf '%*s' 1024 DDDD 2026-02-17T08:19:42.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:78: rados_put_get: rados --pool pool-shec put SOMETHING td/test-erasure-code/ORIGINAL 2026-02-17T08:19:42.139 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:79: rados_put_get: rados --pool pool-shec get SOMETHING td/test-erasure-code/COPY 2026-02-17T08:19:42.165 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:80: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-17T08:19:42.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:81: rados_put_get: rm td/test-erasure-code/COPY 2026-02-17T08:19:42.168 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: get_osds pool-shec SOMETHING 2026-02-17T08:19:42.168 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-shec 2026-02-17T08:19:42.168 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=SOMETHING 2026-02-17T08:19:42.169 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-shec SOMETHING 2026-02-17T08:19:42.169 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:19:42.368 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=7 2026-02-17T08:19:42.369 INFO:tasks.workunit.client.0.trial059.stderr:9 2026-02-17T08:19:42.369 INFO:tasks.workunit.client.0.trial059.stderr:1' 2026-02-17T08:19:42.369 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 7 9 1 2026-02-17T08:19:42.369 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: initial_osds=('7' '9' '1') 2026-02-17T08:19:42.369 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:88: rados_put_get: local -a initial_osds 2026-02-17T08:19:42.369 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:89: rados_put_get: local last=2 2026-02-17T08:19:42.369 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:90: rados_put_get: ceph osd out 1 2026-02-17T08:19:42.615 INFO:tasks.workunit.client.0.trial059.stderr:osd.1 is already out. 2026-02-17T08:19:42.624 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:93: rados_put_get: sleep 5 2026-02-17T08:19:47.627 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: get_osds pool-shec SOMETHING 2026-02-17T08:19:47.627 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-shec 2026-02-17T08:19:47.627 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=SOMETHING 2026-02-17T08:19:47.627 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:94: rados_put_get: grep '\<1\>' 2026-02-17T08:19:47.628 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-shec SOMETHING 2026-02-17T08:19:47.628 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:19:47.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=7 2026-02-17T08:19:47.826 INFO:tasks.workunit.client.0.trial059.stderr:9 2026-02-17T08:19:47.826 INFO:tasks.workunit.client.0.trial059.stderr:6' 2026-02-17T08:19:47.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 7 9 6 2026-02-17T08:19:47.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:96: rados_put_get: rados --pool pool-shec get SOMETHING td/test-erasure-code/COPY 2026-02-17T08:19:47.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:97: rados_put_get: diff td/test-erasure-code/ORIGINAL td/test-erasure-code/COPY 2026-02-17T08:19:47.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:98: rados_put_get: ceph osd in 1 2026-02-17T08:19:48.089 INFO:tasks.workunit.client.0.trial059.stderr:osd.1 is already in. 2026-02-17T08:19:48.098 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:100: rados_put_get: rm td/test-erasure-code/ORIGINAL 2026-02-17T08:19:48.099 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:248: TEST_rados_put_get_shec: delete_pool pool-shec 2026-02-17T08:19:48.100 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=pool-shec 2026-02-17T08:19:48.100 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete pool-shec pool-shec --yes-i-really-really-mean-it 2026-02-17T08:19:48.391 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-shec' does not exist 2026-02-17T08:19:48.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:249: TEST_rados_put_get_shec: ceph osd erasure-code-profile rm profile-shec 2026-02-17T08:19:48.657 INFO:tasks.workunit.client.0.trial059.stderr:erasure-code-profile profile-shec does not exist 2026-02-17T08:19:48.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:51: run: delete_pool ecpool 2026-02-17T08:19:48.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=ecpool 2026-02-17T08:19:48.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete ecpool ecpool --yes-i-really-really-mean-it 2026-02-17T08:19:48.958 INFO:tasks.workunit.client.0.trial059.stderr:pool 'ecpool' does not exist 2026-02-17T08:19:48.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh:52: run: teardown td/test-erasure-code 2026-02-17T08:19:48.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code 2026-02-17T08:19:48.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:19:48.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code KILL 2026-02-17T08:19:48.968 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:19:48.968 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:19:48.969 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:19:48.969 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:19:48.969 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:19:49.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:19:49.281 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:19:49.282 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:19:49.283 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:19:49.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:19:49.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:19:49.285 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:19:49.286 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:19:49.286 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:19:49.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:19:49.287 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:19:49.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:19:49.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:19:49.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code 2026-02-17T08:19:49.352 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:19:49.352 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:19:49.352 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:19:49.352 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.41658 2026-02-17T08:19:49.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:19:49.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:19:49.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: main: code=0 2026-02-17T08:19:49.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: main: teardown td/test-erasure-code 0 2026-02-17T08:19:49.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-code 2026-02-17T08:19:49.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2026-02-17T08:19:49.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-code KILL 2026-02-17T08:19:49.355 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:19:49.355 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:19:49.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:19:49.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:19:49.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:19:49.356 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:19:49.357 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:19:49.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:19:49.358 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:19:49.359 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:19:49.359 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:19:49.360 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:19:49.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:19:49.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:19:49.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:19:49.362 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:19:49.362 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:19:49.363 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T08:19:49.364 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-code 2026-02-17T08:19:49.365 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:19:49.365 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:19:49.365 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41658 2026-02-17T08:19:49.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.41658 2026-02-17T08:19:49.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:19:49.367 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:19:49.367 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: main: return 0 2026-02-17T08:19:49.368 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T08:19:49.368 DEBUG:teuthology.orchestra.run.trial059:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T08:19:49.377 INFO:tasks.workunit:Running workunit erasure-code/test-erasure-eio.sh... 2026-02-17T08:19:49.377 DEBUG:teuthology.orchestra.run.trial059:workunit test erasure-code/test-erasure-eio.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh 2026-02-17T08:19:49.428 INFO:tasks.workunit.client.0.trial059.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T08:19:49.434 INFO:tasks.workunit.client.0.trial059.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T08:19:49.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T08:19:49.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T08:19:49.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: export PYTHONWARNINGS=ignore 2026-02-17T08:19:49.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: PYTHONWARNINGS=ignore 2026-02-17T08:19:49.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: export CEPH_CONF=/dev/null 2026-02-17T08:19:49.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: CEPH_CONF=/dev/null 2026-02-17T08:19:49.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: main: unset CEPH_ARGS 2026-02-17T08:19:49.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2375: main: local code 2026-02-17T08:19:49.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: main: run td/test-erasure-eio 2026-02-17T08:19:49.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:22: run: local dir=td/test-erasure-eio 2026-02-17T08:19:49.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:23: run: shift 2026-02-17T08:19:49.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:25: run: export CEPH_MON=127.0.0.1:7112 2026-02-17T08:19:49.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:25: run: CEPH_MON=127.0.0.1:7112 2026-02-17T08:19:49.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:26: run: export CEPH_ARGS 2026-02-17T08:19:49.435 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:27: run: uuidgen 2026-02-17T08:19:49.436 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:27: run: CEPH_ARGS+='--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none ' 2026-02-17T08:19:49.436 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7112 ' 2026-02-17T08:19:49.436 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:29: run: CEPH_ARGS+='--osd_mclock_override_recovery_settings=true ' 2026-02-17T08:19:49.436 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:31: run: set 2026-02-17T08:19:49.436 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:31: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T08:19:49.439 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:31: run: local 'funcs=TEST_ec_backfill_unfound 2026-02-17T08:19:49.439 INFO:tasks.workunit.client.0.trial059.stderr:TEST_ec_object_attr_read_error 2026-02-17T08:19:49.439 INFO:tasks.workunit.client.0.trial059.stderr:TEST_ec_recovery_multiple_errors 2026-02-17T08:19:49.439 INFO:tasks.workunit.client.0.trial059.stderr:TEST_ec_recovery_multiple_objects 2026-02-17T08:19:49.439 INFO:tasks.workunit.client.0.trial059.stderr:TEST_ec_recovery_multiple_objects_eio 2026-02-17T08:19:49.439 INFO:tasks.workunit.client.0.trial059.stderr:TEST_ec_recovery_unfound 2026-02-17T08:19:49.439 INFO:tasks.workunit.client.0.trial059.stderr:TEST_ec_single_recovery_error 2026-02-17T08:19:49.439 INFO:tasks.workunit.client.0.trial059.stderr:TEST_rados_get_bad_size_shard_0 2026-02-17T08:19:49.439 INFO:tasks.workunit.client.0.trial059.stderr:TEST_rados_get_bad_size_shard_1 2026-02-17T08:19:49.439 INFO:tasks.workunit.client.0.trial059.stderr:TEST_rados_get_subread_eio_shard_0 2026-02-17T08:19:49.439 INFO:tasks.workunit.client.0.trial059.stderr:TEST_rados_get_subread_eio_shard_1 2026-02-17T08:19:49.439 INFO:tasks.workunit.client.0.trial059.stderr:TEST_rados_get_subread_missing 2026-02-17T08:19:49.439 INFO:tasks.workunit.client.0.trial059.stderr:TEST_rados_get_with_subreadall_eio_shard_0 2026-02-17T08:19:49.440 INFO:tasks.workunit.client.0.trial059.stderr:TEST_rados_get_with_subreadall_eio_shard_1' 2026-02-17T08:19:49.440 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-17T08:19:49.440 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-17T08:19:49.440 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-eio 2026-02-17T08:19:49.440 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-eio 2026-02-17T08:19:49.440 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:19:49.440 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:19:49.440 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:19:49.440 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:19:49.440 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:19:49.440 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:19:49.441 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:19:49.441 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:19:49.441 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:19:49.441 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:19:49.442 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:19:49.443 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:19:49.444 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:19:49.444 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:19:49.444 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:19:49.445 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:19:49.445 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:19:49.446 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:19:49.446 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:19:49.447 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:19:49.448 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:19:49.448 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:19:49.450 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:19:49.450 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:19:49.450 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:19:49.450 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:19:49.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:19:49.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:19:49.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-eio 2026-02-17T08:19:49.453 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:19:49.453 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:19:49.453 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:19:49.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.70936 2026-02-17T08:19:49.455 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:19:49.456 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2026-02-17T08:19:49.456 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2026-02-17T08:19:49.456 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:19:49.456 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-17T08:19:49.456 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-17T08:19:49.456 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-eio 2026-02-17T08:19:49.456 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:19:49.456 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:19:49.457 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:19:49.457 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-eio/a 2026-02-17T08:19:49.457 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-17T08:19:49.481 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:19:49.481 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:19:49.481 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:19:49.481 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:19:49.482 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:19:49.482 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:19:49.482 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:19:49.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T08:19:49.509 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:19:49.510 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:19:49.510 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:19:49.510 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:19:49.510 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:19:49.510 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:19:49.511 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:19:49.511 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:19:49.512 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:19:49.512 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:19:49.512 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:19:49.512 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:19:49.512 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:19:49.512 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:19:49.512 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get fsid 2026-02-17T08:19:49.566 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:19:49.566 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:19:49.566 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:19:49.566 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:19:49.566 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:19:49.567 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:19:49.567 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:19:49.568 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:19:49.568 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:19:49.568 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:19:49.568 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:19:49.568 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:19:49.568 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:19:49.568 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get mon_host 2026-02-17T08:19:49.623 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-17T08:19:49.623 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-eio 2026-02-17T08:19:49.623 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:19:49.624 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:19:49.624 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:19:49.624 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-eio/x 2026-02-17T08:19:49.624 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:19:49.734 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:19:49.734 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:19:49.734 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:19:49.734 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:19:49.734 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:19:49.734 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:19:49.735 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:19:49.735 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:19:49.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:19:49.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-17T08:19:49.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T08:19:49.869 INFO:tasks.workunit.client.0.trial059.stderr:pool 'rbd' already exists 2026-02-17T08:19:49.877 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:19:50.879 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-17T08:19:50.879 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:19:50.879 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:19:50.880 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:19:50.880 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:19:50.880 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:19:50.880 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:19:50.880 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-17T08:19:50.880 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-mon.a.asok log flush 2026-02-17T08:19:50.928 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:19:50.934 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-17T08:19:50.936 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:19:49.493+0000 7fa17adc2ec0 0 load: jerasure load: lrc 2026-02-17T08:19:50.937 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_ec_backfill_unfound td/test-erasure-eio 2026-02-17T08:19:50.937 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:511: TEST_ec_backfill_unfound: local dir=td/test-erasure-eio 2026-02-17T08:19:50.937 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:512: TEST_ec_backfill_unfound: local objname=myobject 2026-02-17T08:19:50.938 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:513: TEST_ec_backfill_unfound: local lastobj=300 2026-02-17T08:19:50.938 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:515: TEST_ec_backfill_unfound: local testobj=obj250 2026-02-17T08:19:50.938 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:517: TEST_ec_backfill_unfound: ORIG_ARGS='--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:19:50.938 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:518: TEST_ec_backfill_unfound: CEPH_ARGS+=' --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-17T08:19:50.938 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:519: TEST_ec_backfill_unfound: setup_osds 5 2026-02-17T08:19:50.938 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=5 2026-02-17T08:19:50.938 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-17T08:19:50.938 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 5 - 1 2026-02-17T08:19:50.941 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 4 2026-02-17T08:19:50.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:19:50.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-17T08:19:50.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:19:50.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:19:50.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:19:50.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:19:50.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-17T08:19:50.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-17T08:19:50.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:19:50.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:19:50.943 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:19:50.943 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-17T08:19:50.943 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-17T08:19:50.943 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:19:50.943 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:19:50.943 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:19:50.943 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:19:50.943 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:19:50.943 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:19:50.943 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:19:50.943 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:19:50.943 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:19:50.944 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:19:50.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:19:50.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:19:50.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:19:50.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:19:50.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:19:50.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:19:50.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:19:50.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:19:50.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:19:50.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:19:50.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:19:50.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:19:50.945 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-17T08:19:50.945 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:19:50.945 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=ff197bb4-5f2e-4c09-97a3-d919f8f6cef7 2026-02-17T08:19:50.945 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 ff197bb4-5f2e-4c09-97a3-d919f8f6cef7 2026-02-17T08:19:50.946 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 ff197bb4-5f2e-4c09-97a3-d919f8f6cef7' 2026-02-17T08:19:50.946 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:19:50.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCmJJRpL4G2OBAAK7FoTW5zqqKLTNolLxM3tQ== 2026-02-17T08:19:50.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCmJJRpL4G2OBAAK7FoTW5zqqKLTNolLxM3tQ=="}' 2026-02-17T08:19:50.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new ff197bb4-5f2e-4c09-97a3-d919f8f6cef7 -i td/test-erasure-eio/0/new.json 2026-02-17T08:19:51.066 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:19:51.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-17T08:19:51.075 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCmJJRpL4G2OBAAK7FoTW5zqqKLTNolLxM3tQ== --osd-uuid ff197bb4-5f2e-4c09-97a3-d919f8f6cef7 2026-02-17T08:19:51.092 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:19:51.089+0000 7fc4a8ccc8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:19:51.093 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:19:51.089+0000 7fc4a8ccc8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:19:51.094 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:19:51.089+0000 7fc4a8ccc8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:19:51.095 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:19:51.089+0000 7fc4a8ccc8c0 -1 bdev(0x55aec1b6dc00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:19:51.095 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:19:51.089+0000 7fc4a8ccc8c0 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-17T08:19:53.645 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-17T08:19:53.645 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:19:53.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:19:53.647 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:19:53.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:19:53.916 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:19:53.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:19:53.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:19:53.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:19:53.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:19:53.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:19:53.943 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:19:53.937+0000 7f0c8a30f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:19:53.944 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:19:53.941+0000 7f0c8a30f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:19:53.946 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:19:53.941+0000 7f0c8a30f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:19:54.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:19:54.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:19:54.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:19:54.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:19:54.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:19:54.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:19:54.123 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:19:54.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:19:54.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:19:54.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:19:54.318 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:19:55.319 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:19:55.319 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:19:55.320 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:19:55.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:19:55.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:19:55.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:19:55.453 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:19:55.449+0000 7f0c8a30f8c0 -1 Falling back to public interface 2026-02-17T08:19:55.517 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:19:56.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:19:56.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:19:56.519 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:19:56.520 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:19:56.520 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:19:56.520 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:19:56.717 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:19:57.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:19:57.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:19:57.719 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:19:57.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:19:57.720 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:19:57.720 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:19:57.915 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:19:58.460 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:19:58.453+0000 7f0c8a30f8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:19:58.916 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:19:58.916 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:19:58.917 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:19:58.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:19:58.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:19:58.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:19:59.119 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 6 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/810704518,v1:127.0.0.1:6803/810704518] [v2:127.0.0.1:6804/810704518,v1:127.0.0.1:6805/810704518] exists,up ff197bb4-5f2e-4c09-97a3-d919f8f6cef7 2026-02-17T08:19:59.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:19:59.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:19:59.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:19:59.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:19:59.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-17T08:19:59.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:19:59.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:19:59.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T08:19:59.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:19:59.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-17T08:19:59.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-17T08:19:59.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:19:59.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:19:59.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:19:59.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-17T08:19:59.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-17T08:19:59.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:19:59.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:19:59.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:19:59.125 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:19:59.125 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:19:59.125 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:19:59.126 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:19:59.126 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:19:59.126 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:19:59.126 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:19:59.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:19:59.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:19:59.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:19:59.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:19:59.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:19:59.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:19:59.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:19:59.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:19:59.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:19:59.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:19:59.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:19:59.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:19:59.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-17T08:19:59.127 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:19:59.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=f281afdb-731a-4508-bf3c-653b931ba830 2026-02-17T08:19:59.127 INFO:tasks.workunit.client.0.trial059.stdout:add osd1 f281afdb-731a-4508-bf3c-653b931ba830 2026-02-17T08:19:59.128 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 f281afdb-731a-4508-bf3c-653b931ba830' 2026-02-17T08:19:59.128 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:19:59.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCvJJRpzuPuBxAAq46A1WYrMcLacuBOtlbdUw== 2026-02-17T08:19:59.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCvJJRpzuPuBxAAq46A1WYrMcLacuBOtlbdUw=="}' 2026-02-17T08:19:59.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new f281afdb-731a-4508-bf3c-653b931ba830 -i td/test-erasure-eio/1/new.json 2026-02-17T08:19:59.334 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:19:59.343 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-17T08:19:59.344 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCvJJRpzuPuBxAAq46A1WYrMcLacuBOtlbdUw== --osd-uuid f281afdb-731a-4508-bf3c-653b931ba830 2026-02-17T08:19:59.361 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:19:59.357+0000 7f9a4e52d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:19:59.363 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:19:59.357+0000 7f9a4e52d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:19:59.364 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:19:59.357+0000 7f9a4e52d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:19:59.364 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:19:59.361+0000 7f9a4e52d8c0 -1 bdev(0x55ef67f9dc00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-17T08:19:59.365 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:19:59.361+0000 7f9a4e52d8c0 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-17T08:20:01.645 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-17T08:20:01.645 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:20:01.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T08:20:01.646 INFO:tasks.workunit.client.0.trial059.stdout:adding osd1 key to auth repository 2026-02-17T08:20:01.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:20:01.920 INFO:tasks.workunit.client.0.trial059.stdout:start osd.1 2026-02-17T08:20:01.921 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T08:20:01.921 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:20:01.921 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:20:01.921 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:20:01.921 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:20:01.945 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:01.940+0000 7f817f6d08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:20:01.946 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:01.940+0000 7f817f6d08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:20:01.948 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:01.940+0000 7f817f6d08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:20:02.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T08:20:02.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:20:02.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:20:02.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:20:02.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:20:02.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:02.124 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:20:02.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:20:02.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:02.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:20:02.323 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:20:03.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:20:03.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:03.325 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:20:03.326 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:20:03.326 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:03.326 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:20:03.446 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:03.440+0000 7f817f6d08c0 -1 Falling back to public interface 2026-02-17T08:20:03.521 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:20:04.522 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:20:04.523 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:04.523 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:20:04.524 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:20:04.524 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:04.524 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:20:04.720 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:20:05.721 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:20:05.721 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:05.721 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:20:05.722 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:20:05.722 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:05.722 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:20:05.915 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:20:06.484 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:06.476+0000 7f817f6d08c0 -1 osd.1 0 log_to_monitors true 2026-02-17T08:20:06.916 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:20:06.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:06.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:20:06.917 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:20:06.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:06.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:20:07.114 INFO:tasks.workunit.client.0.trial059.stdout:osd.1 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/478707351,v1:127.0.0.1:6811/478707351] [v2:127.0.0.1:6812/478707351,v1:127.0.0.1:6813/478707351] exists,up f281afdb-731a-4508-bf3c-653b931ba830 2026-02-17T08:20:07.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:20:07.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:20:07.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:20:07.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:20:07.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-17T08:20:07.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:20:07.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:20:07.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T08:20:07.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:20:07.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-17T08:20:07.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-17T08:20:07.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:20:07.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:20:07.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:20:07.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-17T08:20:07.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-17T08:20:07.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:20:07.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:20:07.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:20:07.116 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:20:07.116 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:20:07.116 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:20:07.116 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:20:07.116 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:20:07.116 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:20:07.116 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:20:07.117 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:20:07.117 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:20:07.117 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:20:07.117 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:20:07.117 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:20:07.117 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:20:07.117 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:20:07.117 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:20:07.117 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:20:07.117 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:20:07.117 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:20:07.117 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:20:07.117 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-17T08:20:07.118 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:20:07.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=a8783306-78d4-4e86-93a3-d040cbb2bd26 2026-02-17T08:20:07.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 a8783306-78d4-4e86-93a3-d040cbb2bd26' 2026-02-17T08:20:07.119 INFO:tasks.workunit.client.0.trial059.stdout:add osd2 a8783306-78d4-4e86-93a3-d040cbb2bd26 2026-02-17T08:20:07.119 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:20:07.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQC3JJRpifS0BxAA4XTGPQ6m6tA7cL9uNfxCUg== 2026-02-17T08:20:07.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQC3JJRpifS0BxAA4XTGPQ6m6tA7cL9uNfxCUg=="}' 2026-02-17T08:20:07.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new a8783306-78d4-4e86-93a3-d040cbb2bd26 -i td/test-erasure-eio/2/new.json 2026-02-17T08:20:07.332 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:20:07.343 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-17T08:20:07.344 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC3JJRpifS0BxAA4XTGPQ6m6tA7cL9uNfxCUg== --osd-uuid a8783306-78d4-4e86-93a3-d040cbb2bd26 2026-02-17T08:20:07.362 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:07.356+0000 7fb0436f08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:20:07.363 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:07.356+0000 7fb0436f08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:20:07.365 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:07.360+0000 7fb0436f08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:20:07.365 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:07.360+0000 7fb0436f08c0 -1 bdev(0x5643c0fd9c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-17T08:20:07.365 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:07.360+0000 7fb0436f08c0 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-17T08:20:09.677 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-17T08:20:09.677 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:20:09.678 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T08:20:09.678 INFO:tasks.workunit.client.0.trial059.stdout:adding osd2 key to auth repository 2026-02-17T08:20:09.678 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:20:09.950 INFO:tasks.workunit.client.0.trial059.stdout:start osd.2 2026-02-17T08:20:09.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T08:20:09.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:20:09.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:20:09.952 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:20:09.952 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:20:09.976 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:09.968+0000 7f09780e48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:20:09.978 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:09.972+0000 7f09780e48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:20:09.979 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:09.972+0000 7f09780e48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:20:10.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T08:20:10.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:20:10.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:20:10.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:20:10.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:20:10.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:10.150 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:20:10.151 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:20:10.151 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:10.151 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:20:10.349 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:20:11.350 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:20:11.351 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:11.351 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:20:11.352 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:20:11.352 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:11.352 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:20:11.478 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:11.472+0000 7f09780e48c0 -1 Falling back to public interface 2026-02-17T08:20:11.548 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:20:12.549 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:20:12.549 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:12.550 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:20:12.550 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:20:12.550 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:12.551 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:20:12.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:20:13.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:20:13.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:13.745 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:20:13.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:20:13.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:13.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:20:13.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:20:14.493 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:14.488+0000 7f09780e48c0 -1 osd.2 0 log_to_monitors true 2026-02-17T08:20:14.945 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:20:14.945 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:14.945 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:20:14.946 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:20:14.946 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:14.946 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:20:15.141 INFO:tasks.workunit.client.0.trial059.stdout:osd.2 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2022670279,v1:127.0.0.1:6819/2022670279] [v2:127.0.0.1:6820/2022670279,v1:127.0.0.1:6821/2022670279] exists,up a8783306-78d4-4e86-93a3-d040cbb2bd26 2026-02-17T08:20:15.145 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:20:15.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:20:15.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:20:15.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:20:15.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-17T08:20:15.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:20:15.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:20:15.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2026-02-17T08:20:15.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:20:15.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-17T08:20:15.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-17T08:20:15.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:20:15.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:20:15.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:20:15.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-17T08:20:15.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-17T08:20:15.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:20:15.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:20:15.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:20:15.147 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:20:15.148 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:20:15.148 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:20:15.148 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:20:15.148 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:20:15.148 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:20:15.148 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:20:15.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:20:15.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:20:15.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:20:15.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:20:15.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:20:15.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:20:15.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:20:15.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:20:15.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:20:15.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:20:15.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:20:15.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:20:15.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-17T08:20:15.149 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:20:15.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=dff822a5-a65e-459b-af0b-1ecd25b2d2e5 2026-02-17T08:20:15.150 INFO:tasks.workunit.client.0.trial059.stdout:add osd3 dff822a5-a65e-459b-af0b-1ecd25b2d2e5 2026-02-17T08:20:15.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 dff822a5-a65e-459b-af0b-1ecd25b2d2e5' 2026-02-17T08:20:15.151 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:20:15.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQC/JJRp/idSCRAAW1n0qgukH+0ax07O5fe9Qw== 2026-02-17T08:20:15.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQC/JJRp/idSCRAAW1n0qgukH+0ax07O5fe9Qw=="}' 2026-02-17T08:20:15.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new dff822a5-a65e-459b-af0b-1ecd25b2d2e5 -i td/test-erasure-eio/3/new.json 2026-02-17T08:20:15.372 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:20:15.381 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-17T08:20:15.382 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC/JJRp/idSCRAAW1n0qgukH+0ax07O5fe9Qw== --osd-uuid dff822a5-a65e-459b-af0b-1ecd25b2d2e5 2026-02-17T08:20:15.399 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:15.392+0000 7f49938328c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:20:15.400 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:15.396+0000 7f49938328c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:20:15.401 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:15.396+0000 7f49938328c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:20:15.402 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:15.396+0000 7f49938328c0 -1 bdev(0x55a571dc3c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-17T08:20:15.402 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:15.396+0000 7f49938328c0 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-17T08:20:17.679 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-17T08:20:17.679 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:20:17.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2026-02-17T08:20:17.680 INFO:tasks.workunit.client.0.trial059.stdout:adding osd3 key to auth repository 2026-02-17T08:20:17.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:20:17.939 INFO:tasks.workunit.client.0.trial059.stdout:start osd.3 2026-02-17T08:20:17.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2026-02-17T08:20:17.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:20:17.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:20:17.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:20:17.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:20:17.954 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:17.948+0000 7f873d4e38c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:20:17.956 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:17.948+0000 7f873d4e38c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:20:17.957 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:17.952+0000 7f873d4e38c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:20:18.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2026-02-17T08:20:18.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:20:18.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T08:20:18.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:20:18.138 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:20:18.138 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:18.138 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:20:18.139 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:20:18.139 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:18.139 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:20:18.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:20:19.342 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:20:19.342 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:19.343 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:20:19.343 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:20:19.343 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:19.343 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:20:19.540 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:20:19.674 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:19.668+0000 7f873d4e38c0 -1 Falling back to public interface 2026-02-17T08:20:20.542 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:20:20.542 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:20.542 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:20:20.542 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:20:20.543 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:20.543 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:20:20.745 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:20:21.747 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:20:21.747 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:21.748 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:20:21.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:20:21.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:21.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:20:21.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:20:22.645 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:22.640+0000 7f873d4e38c0 -1 osd.3 0 log_to_monitors true 2026-02-17T08:20:22.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:20:22.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:22.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:20:22.951 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:20:22.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:22.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:20:23.156 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:20:24.157 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:20:24.158 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:24.158 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:20:24.158 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:20:24.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:24.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:20:24.355 INFO:tasks.workunit.client.0.trial059.stdout:osd.3 up in weight 1 up_from 26 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3578086055,v1:127.0.0.1:6827/3578086055] [v2:127.0.0.1:6828/3578086055,v1:127.0.0.1:6829/3578086055] exists,up dff822a5-a65e-459b-af0b-1ecd25b2d2e5 2026-02-17T08:20:24.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:20:24.359 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:20:24.359 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:20:24.359 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:20:24.359 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 4 2026-02-17T08:20:24.359 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:20:24.359 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:20:24.359 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2026-02-17T08:20:24.359 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:20:24.359 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/4 2026-02-17T08:20:24.359 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-17T08:20:24.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:20:24.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:20:24.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:20:24.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/4' 2026-02-17T08:20:24.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/4/journal' 2026-02-17T08:20:24.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:20:24.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:20:24.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:20:24.360 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:20:24.360 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:20:24.360 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:20:24.360 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:20:24.361 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:20:24.361 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:20:24.361 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:20:24.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:20:24.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:20:24.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:20:24.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:20:24.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:20:24.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:20:24.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:20:24.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:20:24.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:20:24.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:20:24.362 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:20:24.362 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:20:24.362 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/4 2026-02-17T08:20:24.362 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:20:24.362 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=14c16f92-6039-4e70-8fd2-ea5bc25889b6 2026-02-17T08:20:24.363 INFO:tasks.workunit.client.0.trial059.stdout:add osd4 14c16f92-6039-4e70-8fd2-ea5bc25889b6 2026-02-17T08:20:24.363 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 14c16f92-6039-4e70-8fd2-ea5bc25889b6' 2026-02-17T08:20:24.363 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:20:24.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDIJJRp8ZUAFhAA6aycf1bU3sjqQzrOogF9rQ== 2026-02-17T08:20:24.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDIJJRp8ZUAFhAA6aycf1bU3sjqQzrOogF9rQ=="}' 2026-02-17T08:20:24.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 14c16f92-6039-4e70-8fd2-ea5bc25889b6 -i td/test-erasure-eio/4/new.json 2026-02-17T08:20:24.579 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:20:24.589 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/4/new.json 2026-02-17T08:20:24.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDIJJRp8ZUAFhAA6aycf1bU3sjqQzrOogF9rQ== --osd-uuid 14c16f92-6039-4e70-8fd2-ea5bc25889b6 2026-02-17T08:20:24.615 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:24.608+0000 7f47e3b518c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:20:24.617 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:24.612+0000 7f47e3b518c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:20:24.618 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:24.612+0000 7f47e3b518c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:20:24.618 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:24.612+0000 7f47e3b518c0 -1 bdev(0x5586000b1c00 td/test-erasure-eio/4/block) open stat got: (1) Operation not permitted 2026-02-17T08:20:24.618 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:24.612+0000 7f47e3b518c0 -1 bluestore(td/test-erasure-eio/4) _read_fsid unparsable uuid 2026-02-17T08:20:26.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/4/keyring 2026-02-17T08:20:26.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:20:26.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2026-02-17T08:20:26.886 INFO:tasks.workunit.client.0.trial059.stdout:adding osd4 key to auth repository 2026-02-17T08:20:26.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:20:27.156 INFO:tasks.workunit.client.0.trial059.stdout:start osd.4 2026-02-17T08:20:27.156 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2026-02-17T08:20:27.156 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:20:27.157 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:20:27.157 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:20:27.157 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:20:27.174 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:27.168+0000 7f0664a4b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:20:27.175 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:27.168+0000 7f0664a4b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:20:27.176 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:27.168+0000 7f0664a4b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:20:27.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2026-02-17T08:20:27.356 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:20:27.356 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2026-02-17T08:20:27.356 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:20:27.356 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:20:27.356 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:27.356 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:20:27.356 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:20:27.357 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:27.357 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:20:27.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:20:28.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:20:28.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:28.560 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:20:28.560 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:20:28.561 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:28.561 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:20:28.677 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:28.672+0000 7f0664a4b8c0 -1 Falling back to public interface 2026-02-17T08:20:28.761 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:20:29.763 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:20:29.763 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:29.763 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:20:29.764 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:20:29.764 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:29.764 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:20:29.962 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:20:30.964 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:20:30.964 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:30.964 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:20:30.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:20:30.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:30.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:20:31.164 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:20:31.695 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:31.688+0000 7f0664a4b8c0 -1 osd.4 0 log_to_monitors true 2026-02-17T08:20:32.165 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:20:32.165 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:32.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:20:32.166 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:20:32.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:32.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:20:32.370 INFO:tasks.workunit.client.0.trial059.stdout:osd.4 up in weight 1 up_from 34 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/2988512606,v1:127.0.0.1:6835/2988512606] [v2:127.0.0.1:6836/2988512606,v1:127.0.0.1:6837/2988512606] exists,up 14c16f92-6039-4e70-8fd2-ea5bc25889b6 2026-02-17T08:20:32.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:20:32.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:20:32.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:20:32.371 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-17T08:20:32.371 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:20:32.371 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:20:32.372 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:20:32.372 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:20:32.372 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:20:32.372 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.0.asok 2026-02-17T08:20:32.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-17T08:20:32.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.0.asok log flush 2026-02-17T08:20:32.427 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:20:32.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-17T08:20:32.434 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:19:55.453+0000 7f0c8a30f8c0 0 load: jerasure load: lrc 2026-02-17T08:20:32.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:520: TEST_ec_backfill_unfound: CEPH_ARGS='--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:20:32.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:522: TEST_ec_backfill_unfound: local poolname=pool-jerasure 2026-02-17T08:20:32.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:523: TEST_ec_backfill_unfound: create_erasure_coded_pool pool-jerasure 3 2 2026-02-17T08:20:32.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:20:32.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-17T08:20:32.436 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=3 2026-02-17T08:20:32.436 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-17T08:20:32.436 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=2 2026-02-17T08:20:32.436 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-17T08:20:32.436 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=3 m=2 crush-failure-domain=osd 2026-02-17T08:20:32.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-17T08:20:32.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-17T08:20:33.099 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' already exists 2026-02-17T08:20:33.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:20:34.110 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-17T08:20:34.110 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:20:34.110 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:20:34.111 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:20:34.111 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:20:34.112 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:20:34.112 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:20:34.112 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:20:34.112 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:20:34.113 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:20:34.210 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:20:34.210 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:20:34.210 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:20:34.210 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:20:34.210 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:20:34.210 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:20:34.404 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:20:34.404 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:20:34.404 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:20:34.404 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:20:34.404 INFO:tasks.workunit.client.0.trial059.stderr:4' 2026-02-17T08:20:34.405 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:20:34.405 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:20:34.405 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:20:34.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803785 2026-02-17T08:20:34.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803785 2026-02-17T08:20:34.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803785' 2026-02-17T08:20:34.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:20:34.479 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:20:34.554 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=55834574856 2026-02-17T08:20:34.554 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 55834574856 2026-02-17T08:20:34.554 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803785 1-55834574856' 2026-02-17T08:20:34.554 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:20:34.555 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:20:34.629 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411334 2026-02-17T08:20:34.629 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411334 2026-02-17T08:20:34.629 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803785 1-55834574856 2-77309411334' 2026-02-17T08:20:34.629 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:20:34.629 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:20:34.704 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=111669149701 2026-02-17T08:20:34.705 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 111669149701 2026-02-17T08:20:34.705 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803785 1-55834574856 2-77309411334 3-111669149701' 2026-02-17T08:20:34.705 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:20:34.705 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:20:34.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=146028888067 2026-02-17T08:20:34.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 146028888067 2026-02-17T08:20:34.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803785 1-55834574856 2-77309411334 3-111669149701 4-146028888067' 2026-02-17T08:20:34.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:20:34.781 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803785 2026-02-17T08:20:34.781 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:20:34.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:20:34.782 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803785 2026-02-17T08:20:34.782 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:20:34.784 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803785 2026-02-17T08:20:34.784 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803785' 2026-02-17T08:20:34.784 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 25769803785 2026-02-17T08:20:34.785 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:20:34.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803783 -lt 25769803785 2026-02-17T08:20:34.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:20:35.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:20:35.996 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:20:36.192 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803786 -lt 25769803785 2026-02-17T08:20:36.192 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:20:36.193 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-55834574856 2026-02-17T08:20:36.193 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:20:36.194 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:20:36.195 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-55834574856 2026-02-17T08:20:36.195 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:20:36.196 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=55834574856 2026-02-17T08:20:36.196 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 55834574856 2026-02-17T08:20:36.197 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 55834574856' 2026-02-17T08:20:36.197 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:20:36.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 55834574856 -lt 55834574856 2026-02-17T08:20:36.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:20:36.398 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-77309411334 2026-02-17T08:20:36.398 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:20:36.399 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:20:36.400 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-77309411334 2026-02-17T08:20:36.400 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:20:36.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411334 2026-02-17T08:20:36.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 77309411334' 2026-02-17T08:20:36.402 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 77309411334 2026-02-17T08:20:36.402 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:20:36.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411335 -lt 77309411334 2026-02-17T08:20:36.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:20:36.599 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-111669149701 2026-02-17T08:20:36.599 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:20:36.600 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:20:36.601 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-111669149701 2026-02-17T08:20:36.601 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:20:36.603 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=111669149701 2026-02-17T08:20:36.603 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 111669149701' 2026-02-17T08:20:36.603 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 111669149701 2026-02-17T08:20:36.603 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:20:36.813 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 111669149701 -lt 111669149701 2026-02-17T08:20:36.813 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:20:36.814 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-146028888067 2026-02-17T08:20:36.814 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:20:36.815 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:20:36.816 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-146028888067 2026-02-17T08:20:36.816 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:20:36.817 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=146028888067 2026-02-17T08:20:36.817 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 146028888067' 2026-02-17T08:20:36.817 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.4 seq 146028888067 2026-02-17T08:20:36.818 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:20:37.010 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 146028888067 -lt 146028888067 2026-02-17T08:20:37.010 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:20:37.011 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:20:37.011 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:20:37.273 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:20:37.273 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:20:37.274 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:20:37.275 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:20:37.275 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:20:37.275 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:20:37.275 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:20:37.275 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:20:37.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:20:37.472 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:20:37.472 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:20:37.472 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:20:37.734 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:20:37.734 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:20:37.734 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:20:37.734 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:525: TEST_ec_backfill_unfound: ceph pg dump pgs 2026-02-17T08:20:37.917 INFO:tasks.workunit.client.0.trial059.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T08:20:37.918 INFO:tasks.workunit.client.0.trial059.stdout:2.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:20:33.460610+0000 0'0 40:12 [3,1,4,0,2] 3 [3,1,4,0,2] 3 0'0 2026-02-17T08:20:33.048557+0000 0'0 2026-02-17T08:20:33.048557+0000 0 0 periodic scrub scheduled @ 2026-02-18T09:35:37.022198+0000 0 0 2026-02-17T08:20:37.918 INFO:tasks.workunit.client.0.trial059.stdout:1.3 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:20:32.686050+0000 0'0 40:19 [4,1,2] 4 [4,1,2] 4 0'0 2026-02-17T08:19:49.849153+0000 0'0 2026-02-17T08:19:49.849153+0000 0 0 periodic scrub scheduled @ 2026-02-18T16:47:10.114233+0000 0 0 2026-02-17T08:20:37.918 INFO:tasks.workunit.client.0.trial059.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:20:32.687065+0000 0'0 41:90 [0,4,1] 0 [0,4,1] 0 0'0 2026-02-17T08:19:49.849153+0000 0'0 2026-02-17T08:19:49.849153+0000 0 0 periodic scrub scheduled @ 2026-02-18T09:16:44.546686+0000 0 0 2026-02-17T08:20:37.918 INFO:tasks.workunit.client.0.trial059.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:20:33.053564+0000 0'0 40:19 [4,3,0] 4 [4,3,0] 4 0'0 2026-02-17T08:19:49.849153+0000 0'0 2026-02-17T08:19:49.849153+0000 0 0 periodic scrub scheduled @ 2026-02-18T17:24:21.267008+0000 0 0 2026-02-17T08:20:37.918 INFO:tasks.workunit.client.0.trial059.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:20:15.420492+0000 0'0 40:59 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T08:19:49.849153+0000 0'0 2026-02-17T08:19:49.849153+0000 0 0 periodic scrub scheduled @ 2026-02-18T18:32:09.190791+0000 0 0 2026-02-17T08:20:37.918 INFO:tasks.workunit.client.0.trial059.stdout: 2026-02-17T08:20:37.918 INFO:tasks.workunit.client.0.trial059.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T08:20:37.919 INFO:tasks.workunit.client.0.trial059.stderr:dumped pgs 2026-02-17T08:20:37.927 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:527: TEST_ec_backfill_unfound: rados_put td/test-erasure-eio pool-jerasure myobject 2026-02-17T08:20:37.927 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-17T08:20:37.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-17T08:20:37.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=myobject 2026-02-17T08:20:37.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:20:37.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-17T08:20:37.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:20:37.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-17T08:20:37.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:20:37.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-17T08:20:37.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:20:37.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-17T08:20:37.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put myobject td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:37.954 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:528: TEST_ec_backfill_unfound: get_primary pool-jerasure myobject 2026-02-17T08:20:37.954 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=pool-jerasure 2026-02-17T08:20:37.954 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=myobject 2026-02-17T08:20:37.954 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map pool-jerasure myobject 2026-02-17T08:20:37.954 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2026-02-17T08:20:38.156 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:528: TEST_ec_backfill_unfound: local primary=3 2026-02-17T08:20:38.157 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:530: TEST_ec_backfill_unfound: get_osds pool-jerasure myobject 2026-02-17T08:20:38.157 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:20:38.157 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=myobject 2026-02-17T08:20:38.157 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-17T08:20:38.157 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:20:38.354 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:20:38.355 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:20:38.355 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:20:38.355 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:20:38.355 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:20:38.355 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 4 0 2 2026-02-17T08:20:38.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:530: TEST_ec_backfill_unfound: initial_osds=('3' '1' '4' '0' '2') 2026-02-17T08:20:38.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:530: TEST_ec_backfill_unfound: local -a initial_osds 2026-02-17T08:20:38.356 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:531: TEST_ec_backfill_unfound: local last_osd=2 2026-02-17T08:20:38.356 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:532: TEST_ec_backfill_unfound: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-17T08:20:38.356 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:20:38.357 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:20:38.357 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:20:38.357 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:20:38.357 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:20:39.666 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:20:39.666 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:533: TEST_ec_backfill_unfound: ceph osd down 2 2026-02-17T08:20:39.869 INFO:tasks.workunit.client.0.trial059.stderr:osd.2 is already down. 2026-02-17T08:20:39.878 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:534: TEST_ec_backfill_unfound: ceph osd out 2 2026-02-17T08:20:40.119 INFO:tasks.workunit.client.0.trial059.stderr:osd.2 is already out. 2026-02-17T08:20:40.129 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:536: TEST_ec_backfill_unfound: ceph pg dump pgs 2026-02-17T08:20:40.325 INFO:tasks.workunit.client.0.trial059.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T08:20:40.325 INFO:tasks.workunit.client.0.trial059.stdout:2.0 1 0 1 0 0 4096 0 0 1 0 1 active+undersized+degraded 2026-02-17T08:20:38.515127+0000 41'1 43:25 [3,1,4,0,NONE] 3 [3,1,4,0,NONE] 3 0'0 2026-02-17T08:20:33.048557+0000 0'0 2026-02-17T08:20:33.048557+0000 0 0 no scrub is scheduled 0 0 2026-02-17T08:20:40.325 INFO:tasks.workunit.client.0.trial059.stdout:1.3 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:20:32.686050+0000 0'0 41:21 [4,1,2] 4 [4,1,2] 4 0'0 2026-02-17T08:19:49.849153+0000 0'0 2026-02-17T08:19:49.849153+0000 0 0 periodic scrub scheduled @ 2026-02-18T16:47:10.114233+0000 0 0 2026-02-17T08:20:40.325 INFO:tasks.workunit.client.0.trial059.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:20:32.687065+0000 0'0 43:94 [0,4,1] 0 [0,4,1] 0 0'0 2026-02-17T08:19:49.849153+0000 0'0 2026-02-17T08:19:49.849153+0000 0 0 periodic scrub scheduled @ 2026-02-18T09:16:44.546686+0000 0 0 2026-02-17T08:20:40.325 INFO:tasks.workunit.client.0.trial059.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:20:33.053564+0000 0'0 41:21 [4,3,0] 4 [4,3,0] 4 0'0 2026-02-17T08:19:49.849153+0000 0'0 2026-02-17T08:19:49.849153+0000 0 0 periodic scrub scheduled @ 2026-02-18T17:24:21.267008+0000 0 0 2026-02-17T08:20:40.325 INFO:tasks.workunit.client.0.trial059.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:20:15.420492+0000 0'0 41:61 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T08:19:49.849153+0000 0'0 2026-02-17T08:19:49.849153+0000 0 0 periodic scrub scheduled @ 2026-02-18T18:32:09.190791+0000 0 0 2026-02-17T08:20:40.325 INFO:tasks.workunit.client.0.trial059.stdout: 2026-02-17T08:20:40.325 INFO:tasks.workunit.client.0.trial059.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T08:20:40.326 INFO:tasks.workunit.client.0.trial059.stderr:dumped pgs 2026-02-17T08:20:40.335 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:538: TEST_ec_backfill_unfound: dd if=/dev/urandom of=td/test-erasure-eio/ORIGINAL bs=1024 count=4 2026-02-17T08:20:40.336 INFO:tasks.workunit.client.0.trial059.stderr:4+0 records in 2026-02-17T08:20:40.337 INFO:tasks.workunit.client.0.trial059.stderr:4+0 records out 2026-02-17T08:20:40.337 INFO:tasks.workunit.client.0.trial059.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000104909 s, 39.0 MB/s 2026-02-17T08:20:40.337 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: seq 1 300 2026-02-17T08:20:40.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj1 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj2 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.383 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.383 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj3 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj4 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj5 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj6 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.475 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.475 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj7 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.500 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj8 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.525 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.525 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj9 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.550 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.550 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj10 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.576 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.576 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj11 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.601 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.601 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj12 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.627 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.627 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj13 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj14 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.671 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.671 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj15 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.697 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.697 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj16 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.722 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.722 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj17 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj18 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.764 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.764 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj19 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj20 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.802 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.802 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj21 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj22 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.848 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj23 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.874 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.874 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj24 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.891 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.891 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj25 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj26 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj27 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj28 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj29 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:40.999 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:40.999 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj30 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.024 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.024 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj31 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj32 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.067 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.067 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj33 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.092 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.092 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj34 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj35 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj36 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj37 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.192 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.192 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj38 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.219 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj39 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.245 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.245 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj40 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.270 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj41 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.296 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.297 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj42 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.315 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.315 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj43 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.340 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj44 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj45 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.383 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.383 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj46 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj47 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj48 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.460 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.460 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj49 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.485 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj50 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.511 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.512 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj51 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.536 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.536 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj52 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.562 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.562 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj53 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj54 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.614 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.614 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj55 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.640 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.640 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj56 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.665 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.665 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj57 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.690 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.690 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj58 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.716 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.717 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj59 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.742 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.742 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj60 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.760 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.761 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj61 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.784 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.784 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj62 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.808 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.808 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj63 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.827 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.827 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj64 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.852 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.852 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj65 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.875 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.875 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj66 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.901 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.901 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj67 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj68 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj69 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:41.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:41.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj70 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.001 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.001 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj71 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.020 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.020 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj72 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.040 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.040 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj73 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.057 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.058 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj74 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.077 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.077 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj75 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj76 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj77 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj78 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.165 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.165 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj79 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.191 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.191 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj80 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.209 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.209 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj81 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.231 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.231 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj82 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.256 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.256 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj83 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.282 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.282 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj84 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.307 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.307 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj85 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.332 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.332 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj86 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj87 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.383 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.383 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj88 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj89 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.424 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.424 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj90 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.448 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.448 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj91 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.475 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.475 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj92 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.500 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.501 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj93 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.526 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.526 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj94 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.550 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.550 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj95 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj96 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj97 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.603 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.603 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj98 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj99 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.645 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.645 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj100 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.670 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.670 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj101 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.695 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.695 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj102 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.721 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.721 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj103 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj104 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj105 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.799 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.799 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj106 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj107 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj108 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.877 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.877 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj109 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.896 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.896 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj110 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.920 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj111 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj112 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.971 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.971 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj113 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:42.997 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:42.997 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj114 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj115 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj116 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.066 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.067 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj117 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.092 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.092 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj118 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.117 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.118 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj119 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj120 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.169 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.169 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj121 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj122 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.221 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.221 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj123 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.247 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.247 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj124 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.273 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.273 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj125 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj126 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj127 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.349 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.350 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj128 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.375 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.375 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj129 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj130 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.421 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.421 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj131 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.441 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.441 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj132 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.464 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.464 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj133 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.483 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.483 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj134 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.508 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.508 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj135 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj136 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.549 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.549 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj137 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.573 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.573 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj138 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.597 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.597 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj139 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj140 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.641 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.641 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj141 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj142 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.692 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.692 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj143 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.711 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.711 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj144 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj145 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.760 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.760 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj146 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj147 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.804 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.805 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj148 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.829 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.829 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj149 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.848 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.848 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj150 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj151 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.897 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.897 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj152 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.923 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.923 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj153 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj154 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:43.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:43.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj155 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.001 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.001 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj156 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.020 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.020 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj157 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj158 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.062 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.062 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj159 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.088 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj160 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj161 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.131 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.131 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj162 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.155 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.155 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj163 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj164 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj165 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj166 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj167 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.265 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.265 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj168 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj169 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj170 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.340 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj171 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj172 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.385 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.385 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj173 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.404 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.404 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj174 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj175 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj176 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.472 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.472 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj177 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj178 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.521 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.522 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj179 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.547 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.547 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj180 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.573 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.574 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj181 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.599 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.599 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj182 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.625 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.625 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj183 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.644 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.644 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj184 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj185 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj186 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj187 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.739 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.739 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj188 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj189 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj190 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj191 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj192 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.870 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.870 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj193 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.896 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.896 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj194 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.915 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.915 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj195 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.934 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.934 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj196 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.959 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.959 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj197 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:44.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:44.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj198 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj199 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.025 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.025 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj200 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj201 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.076 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.076 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj202 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.102 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.102 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj203 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj204 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.152 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.152 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj205 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj206 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.196 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.196 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj207 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.215 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.215 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj208 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj209 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.265 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.266 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj210 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.291 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.291 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj211 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.316 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.316 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj212 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.342 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.342 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj213 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.368 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.368 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj214 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.385 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.385 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj215 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj216 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj217 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.458 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.458 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj218 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.484 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.484 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj219 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.503 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.503 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj220 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.527 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.528 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj221 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.547 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.547 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj222 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.566 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.566 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj223 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj224 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.607 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj225 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj226 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj227 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj228 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj229 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.738 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.738 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj230 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj231 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj232 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.804 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.804 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj233 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj234 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj235 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.869 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.869 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj236 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.893 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.894 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj237 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj238 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.945 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.945 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj239 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.970 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.970 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj240 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:45.997 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:45.997 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj241 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj242 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj243 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.057 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.057 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj244 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.081 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.081 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj245 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.103 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.103 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj246 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.129 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.129 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj247 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.155 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.155 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj248 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj249 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.205 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.205 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj250 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.231 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.231 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj251 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.257 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.257 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj252 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.276 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.276 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj253 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj254 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj255 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.343 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.343 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj256 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.369 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.369 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj257 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.394 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.394 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj258 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.420 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.420 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj259 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.445 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.445 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj260 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.469 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.469 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj261 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj262 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.520 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.520 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj263 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.542 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.542 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj264 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.562 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.562 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj265 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.580 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.580 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj266 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.604 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.604 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj267 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.628 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.628 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj268 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj269 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.678 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.679 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj270 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.704 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.704 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj271 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.722 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.723 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj272 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.747 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.747 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj273 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj274 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj275 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.817 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.817 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj276 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.835 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.835 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj277 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.856 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.856 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj278 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.877 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.877 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj279 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.899 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.900 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj280 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.925 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.925 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj281 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj282 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj283 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:46.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:46.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj284 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:47.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:47.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj285 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:47.042 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:47.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj286 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:47.068 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:47.068 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj287 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:47.094 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:47.094 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj288 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:47.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:47.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj289 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:47.135 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:47.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj290 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:47.155 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:47.155 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj291 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:47.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:47.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj292 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:47.198 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:47.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj293 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:47.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:47.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj294 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:47.245 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:47.245 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj295 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:47.264 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:47.265 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj296 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:47.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:47.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj297 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:47.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:47.305 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj298 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:47.328 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:47.328 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj299 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:47.353 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:539: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:20:47.353 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:541: TEST_ec_backfill_unfound: rados --pool pool-jerasure put obj300 td/test-erasure-eio/ORIGINAL 2026-02-17T08:20:47.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:544: TEST_ec_backfill_unfound: inject_eio ec data pool-jerasure obj250 td/test-erasure-eio 0 2026-02-17T08:20:47.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2457: inject_eio: local pooltype=ec 2026-02-17T08:20:47.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2458: inject_eio: shift 2026-02-17T08:20:47.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2459: inject_eio: local which=data 2026-02-17T08:20:47.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2460: inject_eio: shift 2026-02-17T08:20:47.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2461: inject_eio: local poolname=pool-jerasure 2026-02-17T08:20:47.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2462: inject_eio: shift 2026-02-17T08:20:47.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2463: inject_eio: local objname=obj250 2026-02-17T08:20:47.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2464: inject_eio: shift 2026-02-17T08:20:47.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2465: inject_eio: local dir=td/test-erasure-eio 2026-02-17T08:20:47.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2466: inject_eio: shift 2026-02-17T08:20:47.381 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2467: inject_eio: local shard_id=0 2026-02-17T08:20:47.381 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2468: inject_eio: shift 2026-02-17T08:20:47.381 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: get_osds pool-jerasure obj250 2026-02-17T08:20:47.381 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:20:47.381 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj250 2026-02-17T08:20:47.381 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj250 2026-02-17T08:20:47.382 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:20:47.576 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:20:47.576 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:20:47.576 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:20:47.577 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:20:47.577 INFO:tasks.workunit.client.0.trial059.stderr:2147483647' 2026-02-17T08:20:47.577 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 4 0 2147483647 2026-02-17T08:20:47.577 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: initial_osds=('3' '1' '4' '0' '2147483647') 2026-02-17T08:20:47.577 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: local -a initial_osds 2026-02-17T08:20:47.577 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2471: inject_eio: local osd_id=3 2026-02-17T08:20:47.577 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2472: inject_eio: '[' ec '!=' ec ']' 2026-02-17T08:20:47.578 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: cat td/test-erasure-eio/3/type 2026-02-17T08:20:47.578 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: type=bluestore 2026-02-17T08:20:47.578 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2476: inject_eio: set_config osd 3 bluestore_debug_inject_read_err true 2026-02-17T08:20:47.578 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1161: set_config: local daemon=osd 2026-02-17T08:20:47.579 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1162: set_config: local id=3 2026-02-17T08:20:47.579 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1163: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T08:20:47.579 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1164: set_config: local value=true 2026-02-17T08:20:47.579 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: jq 'has("success")' 2026-02-17T08:20:47.580 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: get_asok_path osd.3 2026-02-17T08:20:47.580 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2026-02-17T08:20:47.580 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2026-02-17T08:20:47.580 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:20:47.580 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:20:47.580 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:20:47.580 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.3.asok 2026-02-17T08:20:47.581 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.70936/ceph-osd.3.asok config set bluestore_debug_inject_read_err true 2026-02-17T08:20:47.639 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: test true == true 2026-02-17T08:20:47.639 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2477: inject_eio: local loop=0 2026-02-17T08:20:47.640 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2479: inject_eio: grep -q Invalid 2026-02-17T08:20:47.640 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: get_asok_path osd.3 2026-02-17T08:20:47.640 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2026-02-17T08:20:47.641 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2026-02-17T08:20:47.641 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:20:47.641 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:20:47.641 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:20:47.641 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.3.asok 2026-02-17T08:20:47.641 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: CEPH_ARGS= 2026-02-17T08:20:47.641 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.3.asok injectdataerr pool-jerasure obj250 0 2026-02-17T08:20:47.697 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:545: TEST_ec_backfill_unfound: inject_eio ec data pool-jerasure obj250 td/test-erasure-eio 1 2026-02-17T08:20:47.697 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2457: inject_eio: local pooltype=ec 2026-02-17T08:20:47.697 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2458: inject_eio: shift 2026-02-17T08:20:47.697 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2459: inject_eio: local which=data 2026-02-17T08:20:47.697 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2460: inject_eio: shift 2026-02-17T08:20:47.698 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2461: inject_eio: local poolname=pool-jerasure 2026-02-17T08:20:47.698 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2462: inject_eio: shift 2026-02-17T08:20:47.698 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2463: inject_eio: local objname=obj250 2026-02-17T08:20:47.698 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2464: inject_eio: shift 2026-02-17T08:20:47.698 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2465: inject_eio: local dir=td/test-erasure-eio 2026-02-17T08:20:47.698 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2466: inject_eio: shift 2026-02-17T08:20:47.698 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2467: inject_eio: local shard_id=1 2026-02-17T08:20:47.698 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2468: inject_eio: shift 2026-02-17T08:20:47.698 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: get_osds pool-jerasure obj250 2026-02-17T08:20:47.698 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:20:47.698 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj250 2026-02-17T08:20:47.699 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj250 2026-02-17T08:20:47.699 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:20:47.901 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:20:47.901 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:20:47.901 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:20:47.901 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:20:47.901 INFO:tasks.workunit.client.0.trial059.stderr:2147483647' 2026-02-17T08:20:47.901 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 4 0 2147483647 2026-02-17T08:20:47.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: initial_osds=('3' '1' '4' '0' '2147483647') 2026-02-17T08:20:47.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: local -a initial_osds 2026-02-17T08:20:47.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2471: inject_eio: local osd_id=1 2026-02-17T08:20:47.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2472: inject_eio: '[' ec '!=' ec ']' 2026-02-17T08:20:47.902 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: cat td/test-erasure-eio/1/type 2026-02-17T08:20:47.903 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: type=bluestore 2026-02-17T08:20:47.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2476: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-17T08:20:47.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1161: set_config: local daemon=osd 2026-02-17T08:20:47.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1162: set_config: local id=1 2026-02-17T08:20:47.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1163: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T08:20:47.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1164: set_config: local value=true 2026-02-17T08:20:47.904 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: jq 'has("success")' 2026-02-17T08:20:47.905 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: get_asok_path osd.1 2026-02-17T08:20:47.905 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2026-02-17T08:20:47.905 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2026-02-17T08:20:47.905 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:20:47.905 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:20:47.906 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:20:47.906 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.1.asok 2026-02-17T08:20:47.906 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.70936/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-17T08:20:47.963 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: test true == true 2026-02-17T08:20:47.963 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2477: inject_eio: local loop=0 2026-02-17T08:20:47.964 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2479: inject_eio: grep -q Invalid 2026-02-17T08:20:47.965 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: get_asok_path osd.1 2026-02-17T08:20:47.965 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2026-02-17T08:20:47.965 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2026-02-17T08:20:47.965 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:20:47.965 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:20:47.965 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:20:47.965 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.1.asok 2026-02-17T08:20:47.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: CEPH_ARGS= 2026-02-17T08:20:47.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.1.asok injectdataerr pool-jerasure obj250 1 2026-02-17T08:20:48.026 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:547: TEST_ec_backfill_unfound: activate_osd td/test-erasure-eio 2 2026-02-17T08:20:48.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-eio 2026-02-17T08:20:48.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:20:48.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=2 2026-02-17T08:20:48.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:20:48.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-17T08:20:48.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:20:48.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:20:48.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:20:48.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:20:48.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-17T08:20:48.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-17T08:20:48.028 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:20:48.028 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:20:48.028 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:20:48.028 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:20:48.028 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:20:48.028 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:20:48.028 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:20:48.028 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:20:48.028 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:20:48.028 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:20:48.029 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:20:48.029 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:20:48.029 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:20:48.030 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:20:48.030 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:20:48.030 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:20:48.030 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:20:48.030 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:20:48.030 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:20:48.030 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:20:48.030 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-17T08:20:48.030 INFO:tasks.workunit.client.0.trial059.stdout:start osd.2 2026-02-17T08:20:48.031 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.2 2026-02-17T08:20:48.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:20:48.032 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-17T08:20:48.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 2 = 2 ']' 2026-02-17T08:20:48.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:20:48.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:20:48.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:20:48.043 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:48.037+0000 7f58984ef8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:20:48.045 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:48.041+0000 7f58984ef8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:20:48.045 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:48.041+0000 7f58984ef8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:20:48.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 2 2026-02-17T08:20:48.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:20:48.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:20:48.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:20:48.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:20:48.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:48.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:20:48.224 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:20:48.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:48.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:20:48.421 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:20:49.313 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:49.309+0000 7f58984ef8c0 -1 Falling back to public interface 2026-02-17T08:20:49.423 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:20:49.423 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:49.423 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:20:49.423 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:20:49.424 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:49.424 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:20:49.625 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:20:50.626 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:20:50.626 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:50.627 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:20:50.627 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:20:50.628 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:50.628 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:20:50.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:20:51.828 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:20:51.828 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:51.828 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:20:51.829 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:20:51.829 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:51.829 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:20:52.026 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:20:52.381 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:20:52.377+0000 7f58984ef8c0 -1 osd.2 41 log_to_monitors true 2026-02-17T08:20:53.029 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:20:53.029 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:20:53.029 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:20:53.030 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:20:53.030 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:20:53.031 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:20:53.222 INFO:tasks.workunit.client.0.trial059.stdout:osd.2 up out weight 0 up_from 47 up_thru 20 down_at 42 last_clean_interval [18,41) [v2:127.0.0.1:6818/3771647424,v1:127.0.0.1:6819/3771647424] [v2:127.0.0.1:6820/3771647424,v1:127.0.0.1:6821/3771647424] exists,up a8783306-78d4-4e86-93a3-d040cbb2bd26 2026-02-17T08:20:53.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:20:53.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:20:53.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:20:53.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:548: TEST_ec_backfill_unfound: ceph osd in 2 2026-02-17T08:20:53.475 INFO:tasks.workunit.client.0.trial059.stderr:osd.2 is already in. 2026-02-17T08:20:53.484 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:550: TEST_ec_backfill_unfound: sleep 15 2026-02-17T08:21:08.486 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:552: TEST_ec_backfill_unfound: seq 1 240 2026-02-17T08:21:08.488 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:552: TEST_ec_backfill_unfound: for tmp in $(seq 1 240) 2026-02-17T08:21:08.488 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:553: TEST_ec_backfill_unfound: get_state 2.0 2026-02-17T08:21:08.489 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:60: get_state: local pgid=2.0 2026-02-17T08:21:08.489 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:61: get_state: local sname=state 2026-02-17T08:21:08.489 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:62: get_state: ceph --format json pg dump pgs 2026-02-17T08:21:08.490 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:63: get_state: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .state' 2026-02-17T08:21:08.682 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:553: TEST_ec_backfill_unfound: state=active+backfill_unfound+undersized+degraded+remapped 2026-02-17T08:21:08.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:554: TEST_ec_backfill_unfound: echo active+backfill_unfound+undersized+degraded+remapped 2026-02-17T08:21:08.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:554: TEST_ec_backfill_unfound: grep backfill_unfound 2026-02-17T08:21:08.684 INFO:tasks.workunit.client.0.trial059.stdout:active+backfill_unfound+undersized+degraded+remapped 2026-02-17T08:21:08.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:555: TEST_ec_backfill_unfound: '[' 0 = 0 ']' 2026-02-17T08:21:08.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:556: TEST_ec_backfill_unfound: break 2026-02-17T08:21:08.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:562: TEST_ec_backfill_unfound: ceph pg dump pgs 2026-02-17T08:21:08.868 INFO:tasks.workunit.client.0.trial059.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T08:21:08.868 INFO:tasks.workunit.client.0.trial059.stdout:2.0 301 1 28 0 1 1232896 0 0 101 200 101 active+backfill_unfound+undersized+degraded+remapped 2026-02-17T08:20:54.785505+0000 45'301 53:903 [3,1,4,0,2] 3 [3,1,4,0,NONE] 3 0'0 2026-02-17T08:20:33.048557+0000 0'0 2026-02-17T08:20:33.048557+0000 0 0 no scrub is scheduled 0 0 2026-02-17T08:21:08.868 INFO:tasks.workunit.client.0.trial059.stdout:1.3 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:20:53.527494+0000 0'0 53:59 [4,1,2] 4 [4,1,2] 4 0'0 2026-02-17T08:19:49.849153+0000 0'0 2026-02-17T08:19:49.849153+0000 0 0 periodic scrub scheduled @ 2026-02-18T18:43:42.967435+0000 0 0 2026-02-17T08:21:08.868 INFO:tasks.workunit.client.0.trial059.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:20:32.687065+0000 0'0 53:112 [0,4,1] 0 [0,4,1] 0 0'0 2026-02-17T08:19:49.849153+0000 0'0 2026-02-17T08:19:49.849153+0000 0 0 periodic scrub scheduled @ 2026-02-18T09:16:44.546686+0000 0 0 2026-02-17T08:21:08.868 INFO:tasks.workunit.client.0.trial059.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:20:33.053564+0000 0'0 53:44 [4,3,0] 4 [4,3,0] 4 0'0 2026-02-17T08:19:49.849153+0000 0'0 2026-02-17T08:19:49.849153+0000 0 0 periodic scrub scheduled @ 2026-02-18T17:24:21.267008+0000 0 0 2026-02-17T08:21:08.869 INFO:tasks.workunit.client.0.trial059.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:20:53.527976+0000 0'0 53:98 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T08:19:49.849153+0000 0'0 2026-02-17T08:19:49.849153+0000 0 0 periodic scrub scheduled @ 2026-02-18T17:42:00.016144+0000 0 0 2026-02-17T08:21:08.869 INFO:tasks.workunit.client.0.trial059.stdout: 2026-02-17T08:21:08.869 INFO:tasks.workunit.client.0.trial059.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T08:21:08.869 INFO:tasks.workunit.client.0.trial059.stderr:dumped pgs 2026-02-17T08:21:08.876 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:563: TEST_ec_backfill_unfound: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-17T08:21:08.877 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:21:08.877 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:21:08.878 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:21:08.878 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:21:08.878 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:21:10.188 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:21:10.188 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:564: TEST_ec_backfill_unfound: sleep 5 2026-02-17T08:21:15.189 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:566: TEST_ec_backfill_unfound: ceph pg dump pgs 2026-02-17T08:21:15.378 INFO:tasks.workunit.client.0.trial059.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T08:21:15.378 INFO:tasks.workunit.client.0.trial059.stdout:2.0 301 1 303 0 1 1232896 0 0 101 200 101 active+recovery_unfound+undersized+degraded 2026-02-17T08:21:09.018625+0000 45'301 55:915 [3,1,4,0,NONE] 3 [3,1,4,0,NONE] 3 0'0 2026-02-17T08:20:33.048557+0000 0'0 2026-02-17T08:20:33.048557+0000 0 0 no scrub is scheduled 0 0 2026-02-17T08:21:15.378 INFO:tasks.workunit.client.0.trial059.stdout:1.3 0 0 0 0 0 0 0 0 0 0 0 active+undersized 2026-02-17T08:21:09.016371+0000 0'0 55:66 [4,1] 4 [4,1] 4 0'0 2026-02-17T08:19:49.849153+0000 0'0 2026-02-17T08:19:49.849153+0000 0 0 no scrub is scheduled 0 0 2026-02-17T08:21:15.378 INFO:tasks.workunit.client.0.trial059.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:20:32.687065+0000 0'0 55:116 [0,4,1] 0 [0,4,1] 0 0'0 2026-02-17T08:19:49.849153+0000 0'0 2026-02-17T08:19:49.849153+0000 0 0 periodic scrub scheduled @ 2026-02-18T09:16:44.546686+0000 0 0 2026-02-17T08:21:15.378 INFO:tasks.workunit.client.0.trial059.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:20:33.053564+0000 0'0 55:48 [4,3,0] 4 [4,3,0] 4 0'0 2026-02-17T08:19:49.849153+0000 0'0 2026-02-17T08:19:49.849153+0000 0 0 periodic scrub scheduled @ 2026-02-18T17:24:21.267008+0000 0 0 2026-02-17T08:21:15.379 INFO:tasks.workunit.client.0.trial059.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+undersized 2026-02-17T08:21:09.015933+0000 0'0 55:105 [1,0] 1 [1,0] 1 0'0 2026-02-17T08:19:49.849153+0000 0'0 2026-02-17T08:19:49.849153+0000 0 0 no scrub is scheduled 0 0 2026-02-17T08:21:15.379 INFO:tasks.workunit.client.0.trial059.stdout: 2026-02-17T08:21:15.379 INFO:tasks.workunit.client.0.trial059.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T08:21:15.379 INFO:tasks.workunit.client.0.trial059.stderr:dumped pgs 2026-02-17T08:21:15.386 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:567: TEST_ec_backfill_unfound: ceph pg 2.0 list_unfound 2026-02-17T08:21:15.470 INFO:tasks.workunit.client.0.trial059.stdout:{ 2026-02-17T08:21:15.470 INFO:tasks.workunit.client.0.trial059.stdout: "num_missing": 1, 2026-02-17T08:21:15.470 INFO:tasks.workunit.client.0.trial059.stdout: "num_unfound": 1, 2026-02-17T08:21:15.471 INFO:tasks.workunit.client.0.trial059.stdout: "objects": [ 2026-02-17T08:21:15.471 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:21:15.471 INFO:tasks.workunit.client.0.trial059.stdout: "oid": { 2026-02-17T08:21:15.471 INFO:tasks.workunit.client.0.trial059.stdout: "oid": "obj250", 2026-02-17T08:21:15.471 INFO:tasks.workunit.client.0.trial059.stdout: "key": "", 2026-02-17T08:21:15.471 INFO:tasks.workunit.client.0.trial059.stdout: "snapid": -2, 2026-02-17T08:21:15.471 INFO:tasks.workunit.client.0.trial059.stdout: "hash": 2249616407, 2026-02-17T08:21:15.471 INFO:tasks.workunit.client.0.trial059.stdout: "max": 0, 2026-02-17T08:21:15.471 INFO:tasks.workunit.client.0.trial059.stdout: "pool": 2, 2026-02-17T08:21:15.471 INFO:tasks.workunit.client.0.trial059.stdout: "namespace": "" 2026-02-17T08:21:15.472 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:21:15.472 INFO:tasks.workunit.client.0.trial059.stdout: "need": "45'251", 2026-02-17T08:21:15.472 INFO:tasks.workunit.client.0.trial059.stdout: "have": "0'0", 2026-02-17T08:21:15.472 INFO:tasks.workunit.client.0.trial059.stdout: "flags": "none", 2026-02-17T08:21:15.472 INFO:tasks.workunit.client.0.trial059.stdout: "clean_regions": "clean_offsets: [], clean_omap: false, new_object: true", 2026-02-17T08:21:15.472 INFO:tasks.workunit.client.0.trial059.stdout: "locations": [ 2026-02-17T08:21:15.472 INFO:tasks.workunit.client.0.trial059.stdout: "0(3)", 2026-02-17T08:21:15.472 INFO:tasks.workunit.client.0.trial059.stdout: "4(2)" 2026-02-17T08:21:15.472 INFO:tasks.workunit.client.0.trial059.stdout: ] 2026-02-17T08:21:15.472 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:21:15.473 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:21:15.473 INFO:tasks.workunit.client.0.trial059.stdout: "state": "NotRecovering", 2026-02-17T08:21:15.473 INFO:tasks.workunit.client.0.trial059.stdout: "available_might_have_unfound": true, 2026-02-17T08:21:15.473 INFO:tasks.workunit.client.0.trial059.stdout: "might_have_unfound": [ 2026-02-17T08:21:15.473 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:21:15.473 INFO:tasks.workunit.client.0.trial059.stdout: "osd": "2(4)", 2026-02-17T08:21:15.473 INFO:tasks.workunit.client.0.trial059.stdout: "status": "osd is down" 2026-02-17T08:21:15.473 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:21:15.473 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:21:15.473 INFO:tasks.workunit.client.0.trial059.stdout: "more": false 2026-02-17T08:21:15.473 INFO:tasks.workunit.client.0.trial059.stdout:} 2026-02-17T08:21:15.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:568: TEST_ec_backfill_unfound: ceph pg 2.0 query 2026-02-17T08:21:15.555 INFO:tasks.workunit.client.0.trial059.stdout:{ 2026-02-17T08:21:15.555 INFO:tasks.workunit.client.0.trial059.stdout: "snap_trimq": "[]", 2026-02-17T08:21:15.555 INFO:tasks.workunit.client.0.trial059.stdout: "snap_trimq_len": 0, 2026-02-17T08:21:15.555 INFO:tasks.workunit.client.0.trial059.stdout: "state": "active+recovery_unfound+undersized+degraded", 2026-02-17T08:21:15.555 INFO:tasks.workunit.client.0.trial059.stdout: "epoch": 55, 2026-02-17T08:21:15.555 INFO:tasks.workunit.client.0.trial059.stdout: "up": [ 2026-02-17T08:21:15.556 INFO:tasks.workunit.client.0.trial059.stdout: 3, 2026-02-17T08:21:15.556 INFO:tasks.workunit.client.0.trial059.stdout: 1, 2026-02-17T08:21:15.556 INFO:tasks.workunit.client.0.trial059.stdout: 4, 2026-02-17T08:21:15.556 INFO:tasks.workunit.client.0.trial059.stdout: 0, 2026-02-17T08:21:15.556 INFO:tasks.workunit.client.0.trial059.stdout: 2147483647 2026-02-17T08:21:15.556 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:21:15.556 INFO:tasks.workunit.client.0.trial059.stdout: "acting": [ 2026-02-17T08:21:15.556 INFO:tasks.workunit.client.0.trial059.stdout: 3, 2026-02-17T08:21:15.556 INFO:tasks.workunit.client.0.trial059.stdout: 1, 2026-02-17T08:21:15.556 INFO:tasks.workunit.client.0.trial059.stdout: 4, 2026-02-17T08:21:15.556 INFO:tasks.workunit.client.0.trial059.stdout: 0, 2026-02-17T08:21:15.557 INFO:tasks.workunit.client.0.trial059.stdout: 2147483647 2026-02-17T08:21:15.557 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:21:15.557 INFO:tasks.workunit.client.0.trial059.stdout: "acting_recovery_backfill": [ 2026-02-17T08:21:15.557 INFO:tasks.workunit.client.0.trial059.stdout: "0(3)", 2026-02-17T08:21:15.557 INFO:tasks.workunit.client.0.trial059.stdout: "1(1)", 2026-02-17T08:21:15.557 INFO:tasks.workunit.client.0.trial059.stdout: "3(0)", 2026-02-17T08:21:15.557 INFO:tasks.workunit.client.0.trial059.stdout: "4(2)" 2026-02-17T08:21:15.557 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:21:15.557 INFO:tasks.workunit.client.0.trial059.stdout: "info": { 2026-02-17T08:21:15.557 INFO:tasks.workunit.client.0.trial059.stdout: "pgid": "2.0s0", 2026-02-17T08:21:15.557 INFO:tasks.workunit.client.0.trial059.stdout: "shared": "0", 2026-02-17T08:21:15.558 INFO:tasks.workunit.client.0.trial059.stdout: "last_update": "45'301", 2026-02-17T08:21:15.558 INFO:tasks.workunit.client.0.trial059.stdout: "last_complete": "45'250", 2026-02-17T08:21:15.558 INFO:tasks.workunit.client.0.trial059.stdout: "log_tail": "45'200", 2026-02-17T08:21:15.558 INFO:tasks.workunit.client.0.trial059.stdout: "last_user_version": 301, 2026-02-17T08:21:15.558 INFO:tasks.workunit.client.0.trial059.stdout: "last_backfill": "MAX", 2026-02-17T08:21:15.558 INFO:tasks.workunit.client.0.trial059.stdout: "purged_snaps": [], 2026-02-17T08:21:15.558 INFO:tasks.workunit.client.0.trial059.stdout: "history": { 2026-02-17T08:21:15.558 INFO:tasks.workunit.client.0.trial059.stdout: "epoch_created": 39, 2026-02-17T08:21:15.558 INFO:tasks.workunit.client.0.trial059.stdout: "epoch_pool_created": 39, 2026-02-17T08:21:15.558 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_started": 55, 2026-02-17T08:21:15.558 INFO:tasks.workunit.client.0.trial059.stdout: "last_interval_started": 54, 2026-02-17T08:21:15.559 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_clean": 40, 2026-02-17T08:21:15.559 INFO:tasks.workunit.client.0.trial059.stdout: "last_interval_clean": 39, 2026-02-17T08:21:15.559 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_split": 0, 2026-02-17T08:21:15.559 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_marked_full": 0, 2026-02-17T08:21:15.559 INFO:tasks.workunit.client.0.trial059.stdout: "same_up_since": 54, 2026-02-17T08:21:15.559 INFO:tasks.workunit.client.0.trial059.stdout: "same_interval_since": 54, 2026-02-17T08:21:15.559 INFO:tasks.workunit.client.0.trial059.stdout: "same_primary_since": 39, 2026-02-17T08:21:15.559 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub": "0'0", 2026-02-17T08:21:15.559 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_stamp": "2026-02-17T08:20:33.048557+0000", 2026-02-17T08:21:15.559 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub": "0'0", 2026-02-17T08:21:15.559 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub_stamp": "2026-02-17T08:20:33.048557+0000", 2026-02-17T08:21:15.560 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean_scrub_stamp": "2026-02-17T08:20:33.048557+0000", 2026-02-17T08:21:15.560 INFO:tasks.workunit.client.0.trial059.stdout: "prior_readable_until_ub": 0 2026-02-17T08:21:15.560 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:21:15.560 INFO:tasks.workunit.client.0.trial059.stdout: "stats": { 2026-02-17T08:21:15.560 INFO:tasks.workunit.client.0.trial059.stdout: "version": "45'301", 2026-02-17T08:21:15.560 INFO:tasks.workunit.client.0.trial059.stdout: "reported_seq": 916, 2026-02-17T08:21:15.560 INFO:tasks.workunit.client.0.trial059.stdout: "reported_epoch": 55, 2026-02-17T08:21:15.560 INFO:tasks.workunit.client.0.trial059.stdout: "state": "active+recovery_unfound+undersized+degraded", 2026-02-17T08:21:15.560 INFO:tasks.workunit.client.0.trial059.stdout: "last_fresh": "2026-02-17T08:21:09.018625+0000", 2026-02-17T08:21:15.560 INFO:tasks.workunit.client.0.trial059.stdout: "last_change": "2026-02-17T08:21:09.018625+0000", 2026-02-17T08:21:15.561 INFO:tasks.workunit.client.0.trial059.stdout: "last_active": "2026-02-17T08:21:09.018625+0000", 2026-02-17T08:21:15.561 INFO:tasks.workunit.client.0.trial059.stdout: "last_peered": "2026-02-17T08:21:09.018625+0000", 2026-02-17T08:21:15.561 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean": "2026-02-17T08:20:37.948266+0000", 2026-02-17T08:21:15.561 INFO:tasks.workunit.client.0.trial059.stdout: "last_became_active": "2026-02-17T08:21:09.016665+0000", 2026-02-17T08:21:15.561 INFO:tasks.workunit.client.0.trial059.stdout: "last_became_peered": "2026-02-17T08:21:09.016665+0000", 2026-02-17T08:21:15.561 INFO:tasks.workunit.client.0.trial059.stdout: "last_unstale": "2026-02-17T08:21:09.018625+0000", 2026-02-17T08:21:15.561 INFO:tasks.workunit.client.0.trial059.stdout: "last_undegraded": "2026-02-17T08:21:09.015163+0000", 2026-02-17T08:21:15.561 INFO:tasks.workunit.client.0.trial059.stdout: "last_fullsized": "2026-02-17T08:21:09.015015+0000", 2026-02-17T08:21:15.561 INFO:tasks.workunit.client.0.trial059.stdout: "mapping_epoch": 54, 2026-02-17T08:21:15.561 INFO:tasks.workunit.client.0.trial059.stdout: "log_start": "45'200", 2026-02-17T08:21:15.561 INFO:tasks.workunit.client.0.trial059.stdout: "ondisk_log_start": "45'200", 2026-02-17T08:21:15.562 INFO:tasks.workunit.client.0.trial059.stdout: "created": 39, 2026-02-17T08:21:15.562 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_clean": 40, 2026-02-17T08:21:15.562 INFO:tasks.workunit.client.0.trial059.stdout: "parent": "0.0", 2026-02-17T08:21:15.562 INFO:tasks.workunit.client.0.trial059.stdout: "parent_split_bits": 0, 2026-02-17T08:21:15.562 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub": "0'0", 2026-02-17T08:21:15.562 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_stamp": "2026-02-17T08:20:33.048557+0000", 2026-02-17T08:21:15.562 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub": "0'0", 2026-02-17T08:21:15.562 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub_stamp": "2026-02-17T08:20:33.048557+0000", 2026-02-17T08:21:15.562 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean_scrub_stamp": "2026-02-17T08:20:33.048557+0000", 2026-02-17T08:21:15.562 INFO:tasks.workunit.client.0.trial059.stdout: "objects_scrubbed": 0, 2026-02-17T08:21:15.562 INFO:tasks.workunit.client.0.trial059.stdout: "log_size": 101, 2026-02-17T08:21:15.563 INFO:tasks.workunit.client.0.trial059.stdout: "log_dups_size": 200, 2026-02-17T08:21:15.563 INFO:tasks.workunit.client.0.trial059.stdout: "ondisk_log_size": 101, 2026-02-17T08:21:15.563 INFO:tasks.workunit.client.0.trial059.stdout: "stats_invalid": false, 2026-02-17T08:21:15.563 INFO:tasks.workunit.client.0.trial059.stdout: "dirty_stats_invalid": false, 2026-02-17T08:21:15.563 INFO:tasks.workunit.client.0.trial059.stdout: "omap_stats_invalid": false, 2026-02-17T08:21:15.563 INFO:tasks.workunit.client.0.trial059.stdout: "hitset_stats_invalid": false, 2026-02-17T08:21:15.563 INFO:tasks.workunit.client.0.trial059.stdout: "hitset_bytes_stats_invalid": false, 2026-02-17T08:21:15.563 INFO:tasks.workunit.client.0.trial059.stdout: "pin_stats_invalid": false, 2026-02-17T08:21:15.563 INFO:tasks.workunit.client.0.trial059.stdout: "manifest_stats_invalid": false, 2026-02-17T08:21:15.563 INFO:tasks.workunit.client.0.trial059.stdout: "snaptrimq_len": 0, 2026-02-17T08:21:15.564 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_duration": 0, 2026-02-17T08:21:15.564 INFO:tasks.workunit.client.0.trial059.stdout: "scrub_schedule": "no scrub is scheduled", 2026-02-17T08:21:15.564 INFO:tasks.workunit.client.0.trial059.stdout: "scrub_duration": 0, 2026-02-17T08:21:15.564 INFO:tasks.workunit.client.0.trial059.stdout: "objects_trimmed": 0, 2026-02-17T08:21:15.564 INFO:tasks.workunit.client.0.trial059.stdout: "snaptrim_duration": 0, 2026-02-17T08:21:15.564 INFO:tasks.workunit.client.0.trial059.stdout: "stat_sum": { 2026-02-17T08:21:15.564 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes": 1232896, 2026-02-17T08:21:15.564 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects": 301, 2026-02-17T08:21:15.564 INFO:tasks.workunit.client.0.trial059.stdout: "num_object_clones": 0, 2026-02-17T08:21:15.564 INFO:tasks.workunit.client.0.trial059.stdout: "num_object_copies": 1505, 2026-02-17T08:21:15.565 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_missing_on_primary": 1, 2026-02-17T08:21:15.565 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_missing": 1, 2026-02-17T08:21:15.565 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_degraded": 303, 2026-02-17T08:21:15.565 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_misplaced": 0, 2026-02-17T08:21:15.565 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_unfound": 1, 2026-02-17T08:21:15.565 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_dirty": 301, 2026-02-17T08:21:15.565 INFO:tasks.workunit.client.0.trial059.stdout: "num_whiteouts": 0, 2026-02-17T08:21:15.565 INFO:tasks.workunit.client.0.trial059.stdout: "num_read": 0, 2026-02-17T08:21:15.565 INFO:tasks.workunit.client.0.trial059.stdout: "num_read_kb": 0, 2026-02-17T08:21:15.565 INFO:tasks.workunit.client.0.trial059.stdout: "num_write": 301, 2026-02-17T08:21:15.565 INFO:tasks.workunit.client.0.trial059.stdout: "num_write_kb": 1204, 2026-02-17T08:21:15.565 INFO:tasks.workunit.client.0.trial059.stdout: "num_scrub_errors": 0, 2026-02-17T08:21:15.565 INFO:tasks.workunit.client.0.trial059.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T08:21:15.566 INFO:tasks.workunit.client.0.trial059.stdout: "num_deep_scrub_errors": 0, 2026-02-17T08:21:15.566 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_recovered": 0, 2026-02-17T08:21:15.566 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes_recovered": 0, 2026-02-17T08:21:15.566 INFO:tasks.workunit.client.0.trial059.stdout: "num_keys_recovered": 0, 2026-02-17T08:21:15.566 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_omap": 0, 2026-02-17T08:21:15.566 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T08:21:15.566 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T08:21:15.566 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush": 0, 2026-02-17T08:21:15.566 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_kb": 0, 2026-02-17T08:21:15.566 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict": 0, 2026-02-17T08:21:15.566 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_kb": 0, 2026-02-17T08:21:15.566 INFO:tasks.workunit.client.0.trial059.stdout: "num_promote": 0, 2026-02-17T08:21:15.566 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_mode_high": 0, 2026-02-17T08:21:15.567 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_mode_low": 0, 2026-02-17T08:21:15.567 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_mode_some": 0, 2026-02-17T08:21:15.567 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_mode_full": 0, 2026-02-17T08:21:15.567 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_pinned": 0, 2026-02-17T08:21:15.567 INFO:tasks.workunit.client.0.trial059.stdout: "num_legacy_snapsets": 0, 2026-02-17T08:21:15.567 INFO:tasks.workunit.client.0.trial059.stdout: "num_large_omap_objects": 0, 2026-02-17T08:21:15.567 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_manifest": 0, 2026-02-17T08:21:15.567 INFO:tasks.workunit.client.0.trial059.stdout: "num_omap_bytes": 0, 2026-02-17T08:21:15.567 INFO:tasks.workunit.client.0.trial059.stdout: "num_omap_keys": 0, 2026-02-17T08:21:15.567 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_repaired": 0 2026-02-17T08:21:15.567 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:21:15.567 INFO:tasks.workunit.client.0.trial059.stdout: "up": [ 2026-02-17T08:21:15.567 INFO:tasks.workunit.client.0.trial059.stdout: 3, 2026-02-17T08:21:15.568 INFO:tasks.workunit.client.0.trial059.stdout: 1, 2026-02-17T08:21:15.568 INFO:tasks.workunit.client.0.trial059.stdout: 4, 2026-02-17T08:21:15.568 INFO:tasks.workunit.client.0.trial059.stdout: 0, 2026-02-17T08:21:15.568 INFO:tasks.workunit.client.0.trial059.stdout: 2147483647 2026-02-17T08:21:15.568 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:21:15.568 INFO:tasks.workunit.client.0.trial059.stdout: "acting": [ 2026-02-17T08:21:15.568 INFO:tasks.workunit.client.0.trial059.stdout: 3, 2026-02-17T08:21:15.568 INFO:tasks.workunit.client.0.trial059.stdout: 1, 2026-02-17T08:21:15.568 INFO:tasks.workunit.client.0.trial059.stdout: 4, 2026-02-17T08:21:15.568 INFO:tasks.workunit.client.0.trial059.stdout: 0, 2026-02-17T08:21:15.568 INFO:tasks.workunit.client.0.trial059.stdout: 2147483647 2026-02-17T08:21:15.568 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:21:15.569 INFO:tasks.workunit.client.0.trial059.stdout: "avail_no_missing": [ 2026-02-17T08:21:15.569 INFO:tasks.workunit.client.0.trial059.stdout: "0(3)", 2026-02-17T08:21:15.569 INFO:tasks.workunit.client.0.trial059.stdout: "4(2)" 2026-02-17T08:21:15.569 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:21:15.569 INFO:tasks.workunit.client.0.trial059.stdout: "object_location_counts": [ 2026-02-17T08:21:15.569 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:21:15.569 INFO:tasks.workunit.client.0.trial059.stdout: "shards": "0(3),1(1),3(0),4(2)", 2026-02-17T08:21:15.569 INFO:tasks.workunit.client.0.trial059.stdout: "objects": 300 2026-02-17T08:21:15.569 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:21:15.569 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:21:15.569 INFO:tasks.workunit.client.0.trial059.stdout: "shards": "0(3),4(2)", 2026-02-17T08:21:15.569 INFO:tasks.workunit.client.0.trial059.stdout: "objects": 1 2026-02-17T08:21:15.569 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:21:15.570 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:21:15.570 INFO:tasks.workunit.client.0.trial059.stdout: "blocked_by": [], 2026-02-17T08:21:15.570 INFO:tasks.workunit.client.0.trial059.stdout: "up_primary": 3, 2026-02-17T08:21:15.570 INFO:tasks.workunit.client.0.trial059.stdout: "acting_primary": 3, 2026-02-17T08:21:15.570 INFO:tasks.workunit.client.0.trial059.stdout: "purged_snaps": [] 2026-02-17T08:21:15.570 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:21:15.570 INFO:tasks.workunit.client.0.trial059.stdout: "empty": 0, 2026-02-17T08:21:15.570 INFO:tasks.workunit.client.0.trial059.stdout: "dne": 0, 2026-02-17T08:21:15.570 INFO:tasks.workunit.client.0.trial059.stdout: "incomplete": 0, 2026-02-17T08:21:15.570 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_started": 55, 2026-02-17T08:21:15.570 INFO:tasks.workunit.client.0.trial059.stdout: "hit_set_history": { 2026-02-17T08:21:15.570 INFO:tasks.workunit.client.0.trial059.stdout: "current_last_update": "0'0", 2026-02-17T08:21:15.570 INFO:tasks.workunit.client.0.trial059.stdout: "history": [] 2026-02-17T08:21:15.570 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:21:15.571 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:21:15.571 INFO:tasks.workunit.client.0.trial059.stdout: "peer_info": [ 2026-02-17T08:21:15.571 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:21:15.571 INFO:tasks.workunit.client.0.trial059.stdout: "peer": "0(3)", 2026-02-17T08:21:15.571 INFO:tasks.workunit.client.0.trial059.stdout: "pgid": "2.0s3", 2026-02-17T08:21:15.571 INFO:tasks.workunit.client.0.trial059.stdout: "shared": "3", 2026-02-17T08:21:15.571 INFO:tasks.workunit.client.0.trial059.stdout: "last_update": "45'301", 2026-02-17T08:21:15.571 INFO:tasks.workunit.client.0.trial059.stdout: "last_complete": "45'301", 2026-02-17T08:21:15.571 INFO:tasks.workunit.client.0.trial059.stdout: "log_tail": "45'200", 2026-02-17T08:21:15.571 INFO:tasks.workunit.client.0.trial059.stdout: "last_user_version": 301, 2026-02-17T08:21:15.571 INFO:tasks.workunit.client.0.trial059.stdout: "last_backfill": "MAX", 2026-02-17T08:21:15.571 INFO:tasks.workunit.client.0.trial059.stdout: "purged_snaps": [], 2026-02-17T08:21:15.571 INFO:tasks.workunit.client.0.trial059.stdout: "history": { 2026-02-17T08:21:15.572 INFO:tasks.workunit.client.0.trial059.stdout: "epoch_created": 39, 2026-02-17T08:21:15.572 INFO:tasks.workunit.client.0.trial059.stdout: "epoch_pool_created": 39, 2026-02-17T08:21:15.572 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_started": 55, 2026-02-17T08:21:15.572 INFO:tasks.workunit.client.0.trial059.stdout: "last_interval_started": 54, 2026-02-17T08:21:15.572 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_clean": 40, 2026-02-17T08:21:15.572 INFO:tasks.workunit.client.0.trial059.stdout: "last_interval_clean": 39, 2026-02-17T08:21:15.572 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_split": 0, 2026-02-17T08:21:15.572 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_marked_full": 0, 2026-02-17T08:21:15.572 INFO:tasks.workunit.client.0.trial059.stdout: "same_up_since": 54, 2026-02-17T08:21:15.572 INFO:tasks.workunit.client.0.trial059.stdout: "same_interval_since": 54, 2026-02-17T08:21:15.572 INFO:tasks.workunit.client.0.trial059.stdout: "same_primary_since": 39, 2026-02-17T08:21:15.572 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub": "0'0", 2026-02-17T08:21:15.572 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_stamp": "2026-02-17T08:20:33.048557+0000", 2026-02-17T08:21:15.573 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub": "0'0", 2026-02-17T08:21:15.573 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub_stamp": "2026-02-17T08:20:33.048557+0000", 2026-02-17T08:21:15.573 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean_scrub_stamp": "2026-02-17T08:20:33.048557+0000", 2026-02-17T08:21:15.573 INFO:tasks.workunit.client.0.trial059.stdout: "prior_readable_until_ub": 0 2026-02-17T08:21:15.573 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:21:15.573 INFO:tasks.workunit.client.0.trial059.stdout: "stats": { 2026-02-17T08:21:15.573 INFO:tasks.workunit.client.0.trial059.stdout: "version": "45'301", 2026-02-17T08:21:15.573 INFO:tasks.workunit.client.0.trial059.stdout: "reported_seq": 906, 2026-02-17T08:21:15.573 INFO:tasks.workunit.client.0.trial059.stdout: "reported_epoch": 54, 2026-02-17T08:21:15.573 INFO:tasks.workunit.client.0.trial059.stdout: "state": "active+undersized+degraded", 2026-02-17T08:21:15.573 INFO:tasks.workunit.client.0.trial059.stdout: "last_fresh": "2026-02-17T08:20:47.374605+0000", 2026-02-17T08:21:15.573 INFO:tasks.workunit.client.0.trial059.stdout: "last_change": "2026-02-17T08:20:38.515127+0000", 2026-02-17T08:21:15.573 INFO:tasks.workunit.client.0.trial059.stdout: "last_active": "2026-02-17T08:20:47.374605+0000", 2026-02-17T08:21:15.574 INFO:tasks.workunit.client.0.trial059.stdout: "last_peered": "2026-02-17T08:20:47.374605+0000", 2026-02-17T08:21:15.574 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean": "2026-02-17T08:20:37.948266+0000", 2026-02-17T08:21:15.574 INFO:tasks.workunit.client.0.trial059.stdout: "last_became_active": "2026-02-17T08:20:38.515127+0000", 2026-02-17T08:21:15.574 INFO:tasks.workunit.client.0.trial059.stdout: "last_became_peered": "2026-02-17T08:20:38.515127+0000", 2026-02-17T08:21:15.574 INFO:tasks.workunit.client.0.trial059.stdout: "last_unstale": "2026-02-17T08:20:47.374605+0000", 2026-02-17T08:21:15.574 INFO:tasks.workunit.client.0.trial059.stdout: "last_undegraded": "2026-02-17T08:20:38.513125+0000", 2026-02-17T08:21:15.574 INFO:tasks.workunit.client.0.trial059.stdout: "last_fullsized": "2026-02-17T08:20:38.513018+0000", 2026-02-17T08:21:15.574 INFO:tasks.workunit.client.0.trial059.stdout: "mapping_epoch": 54, 2026-02-17T08:21:15.574 INFO:tasks.workunit.client.0.trial059.stdout: "log_start": "45'200", 2026-02-17T08:21:15.574 INFO:tasks.workunit.client.0.trial059.stdout: "ondisk_log_start": "45'200", 2026-02-17T08:21:15.574 INFO:tasks.workunit.client.0.trial059.stdout: "created": 39, 2026-02-17T08:21:15.574 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_clean": 40, 2026-02-17T08:21:15.575 INFO:tasks.workunit.client.0.trial059.stdout: "parent": "0.0", 2026-02-17T08:21:15.575 INFO:tasks.workunit.client.0.trial059.stdout: "parent_split_bits": 0, 2026-02-17T08:21:15.575 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub": "0'0", 2026-02-17T08:21:15.575 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_stamp": "2026-02-17T08:20:33.048557+0000", 2026-02-17T08:21:15.575 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub": "0'0", 2026-02-17T08:21:15.575 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub_stamp": "2026-02-17T08:20:33.048557+0000", 2026-02-17T08:21:15.575 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean_scrub_stamp": "2026-02-17T08:20:33.048557+0000", 2026-02-17T08:21:15.575 INFO:tasks.workunit.client.0.trial059.stdout: "objects_scrubbed": 0, 2026-02-17T08:21:15.575 INFO:tasks.workunit.client.0.trial059.stdout: "log_size": 101, 2026-02-17T08:21:15.575 INFO:tasks.workunit.client.0.trial059.stdout: "log_dups_size": 200, 2026-02-17T08:21:15.575 INFO:tasks.workunit.client.0.trial059.stdout: "ondisk_log_size": 101, 2026-02-17T08:21:15.575 INFO:tasks.workunit.client.0.trial059.stdout: "stats_invalid": false, 2026-02-17T08:21:15.575 INFO:tasks.workunit.client.0.trial059.stdout: "dirty_stats_invalid": false, 2026-02-17T08:21:15.576 INFO:tasks.workunit.client.0.trial059.stdout: "omap_stats_invalid": false, 2026-02-17T08:21:15.576 INFO:tasks.workunit.client.0.trial059.stdout: "hitset_stats_invalid": false, 2026-02-17T08:21:15.576 INFO:tasks.workunit.client.0.trial059.stdout: "hitset_bytes_stats_invalid": false, 2026-02-17T08:21:15.576 INFO:tasks.workunit.client.0.trial059.stdout: "pin_stats_invalid": false, 2026-02-17T08:21:15.576 INFO:tasks.workunit.client.0.trial059.stdout: "manifest_stats_invalid": false, 2026-02-17T08:21:15.576 INFO:tasks.workunit.client.0.trial059.stdout: "snaptrimq_len": 0, 2026-02-17T08:21:15.576 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_duration": 0, 2026-02-17T08:21:15.576 INFO:tasks.workunit.client.0.trial059.stdout: "scrub_schedule": "periodic scrub scheduled @ 2026-02-18T11:31:01.420451+0000", 2026-02-17T08:21:15.576 INFO:tasks.workunit.client.0.trial059.stdout: "scrub_duration": 0, 2026-02-17T08:21:15.576 INFO:tasks.workunit.client.0.trial059.stdout: "objects_trimmed": 0, 2026-02-17T08:21:15.576 INFO:tasks.workunit.client.0.trial059.stdout: "snaptrim_duration": 0, 2026-02-17T08:21:15.576 INFO:tasks.workunit.client.0.trial059.stdout: "stat_sum": { 2026-02-17T08:21:15.576 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes": 1232896, 2026-02-17T08:21:15.577 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects": 301, 2026-02-17T08:21:15.577 INFO:tasks.workunit.client.0.trial059.stdout: "num_object_clones": 0, 2026-02-17T08:21:15.577 INFO:tasks.workunit.client.0.trial059.stdout: "num_object_copies": 1505, 2026-02-17T08:21:15.577 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T08:21:15.577 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_missing": 0, 2026-02-17T08:21:15.577 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_degraded": 301, 2026-02-17T08:21:15.577 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_misplaced": 0, 2026-02-17T08:21:15.577 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_unfound": 0, 2026-02-17T08:21:15.577 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_dirty": 301, 2026-02-17T08:21:15.577 INFO:tasks.workunit.client.0.trial059.stdout: "num_whiteouts": 0, 2026-02-17T08:21:15.577 INFO:tasks.workunit.client.0.trial059.stdout: "num_read": 0, 2026-02-17T08:21:15.577 INFO:tasks.workunit.client.0.trial059.stdout: "num_read_kb": 0, 2026-02-17T08:21:15.577 INFO:tasks.workunit.client.0.trial059.stdout: "num_write": 301, 2026-02-17T08:21:15.578 INFO:tasks.workunit.client.0.trial059.stdout: "num_write_kb": 1204, 2026-02-17T08:21:15.578 INFO:tasks.workunit.client.0.trial059.stdout: "num_scrub_errors": 0, 2026-02-17T08:21:15.578 INFO:tasks.workunit.client.0.trial059.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T08:21:15.578 INFO:tasks.workunit.client.0.trial059.stdout: "num_deep_scrub_errors": 0, 2026-02-17T08:21:15.578 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_recovered": 0, 2026-02-17T08:21:15.578 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes_recovered": 0, 2026-02-17T08:21:15.578 INFO:tasks.workunit.client.0.trial059.stdout: "num_keys_recovered": 0, 2026-02-17T08:21:15.578 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_omap": 0, 2026-02-17T08:21:15.578 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T08:21:15.578 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T08:21:15.578 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush": 0, 2026-02-17T08:21:15.578 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_kb": 0, 2026-02-17T08:21:15.578 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict": 0, 2026-02-17T08:21:15.579 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_kb": 0, 2026-02-17T08:21:15.579 INFO:tasks.workunit.client.0.trial059.stdout: "num_promote": 0, 2026-02-17T08:21:15.579 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_mode_high": 0, 2026-02-17T08:21:15.579 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_mode_low": 0, 2026-02-17T08:21:15.579 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_mode_some": 0, 2026-02-17T08:21:15.579 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_mode_full": 0, 2026-02-17T08:21:15.579 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_pinned": 0, 2026-02-17T08:21:15.579 INFO:tasks.workunit.client.0.trial059.stdout: "num_legacy_snapsets": 0, 2026-02-17T08:21:15.579 INFO:tasks.workunit.client.0.trial059.stdout: "num_large_omap_objects": 0, 2026-02-17T08:21:15.579 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_manifest": 0, 2026-02-17T08:21:15.579 INFO:tasks.workunit.client.0.trial059.stdout: "num_omap_bytes": 0, 2026-02-17T08:21:15.579 INFO:tasks.workunit.client.0.trial059.stdout: "num_omap_keys": 0, 2026-02-17T08:21:15.579 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_repaired": 0 2026-02-17T08:21:15.580 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:21:15.580 INFO:tasks.workunit.client.0.trial059.stdout: "up": [ 2026-02-17T08:21:15.580 INFO:tasks.workunit.client.0.trial059.stdout: 3, 2026-02-17T08:21:15.580 INFO:tasks.workunit.client.0.trial059.stdout: 1, 2026-02-17T08:21:15.580 INFO:tasks.workunit.client.0.trial059.stdout: 4, 2026-02-17T08:21:15.580 INFO:tasks.workunit.client.0.trial059.stdout: 0, 2026-02-17T08:21:15.580 INFO:tasks.workunit.client.0.trial059.stdout: 2147483647 2026-02-17T08:21:15.580 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:21:15.580 INFO:tasks.workunit.client.0.trial059.stdout: "acting": [ 2026-02-17T08:21:15.580 INFO:tasks.workunit.client.0.trial059.stdout: 3, 2026-02-17T08:21:15.580 INFO:tasks.workunit.client.0.trial059.stdout: 1, 2026-02-17T08:21:15.580 INFO:tasks.workunit.client.0.trial059.stdout: 4, 2026-02-17T08:21:15.580 INFO:tasks.workunit.client.0.trial059.stdout: 0, 2026-02-17T08:21:15.581 INFO:tasks.workunit.client.0.trial059.stdout: 2147483647 2026-02-17T08:21:15.581 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:21:15.581 INFO:tasks.workunit.client.0.trial059.stdout: "avail_no_missing": [ 2026-02-17T08:21:15.581 INFO:tasks.workunit.client.0.trial059.stdout: "3(0)", 2026-02-17T08:21:15.581 INFO:tasks.workunit.client.0.trial059.stdout: "0(3)", 2026-02-17T08:21:15.581 INFO:tasks.workunit.client.0.trial059.stdout: "1(1)", 2026-02-17T08:21:15.581 INFO:tasks.workunit.client.0.trial059.stdout: "4(2)" 2026-02-17T08:21:15.581 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:21:15.581 INFO:tasks.workunit.client.0.trial059.stdout: "object_location_counts": [ 2026-02-17T08:21:15.581 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:21:15.581 INFO:tasks.workunit.client.0.trial059.stdout: "shards": "0(3),1(1),3(0),4(2)", 2026-02-17T08:21:15.581 INFO:tasks.workunit.client.0.trial059.stdout: "objects": 301 2026-02-17T08:21:15.581 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:21:15.582 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:21:15.582 INFO:tasks.workunit.client.0.trial059.stdout: "blocked_by": [], 2026-02-17T08:21:15.582 INFO:tasks.workunit.client.0.trial059.stdout: "up_primary": 3, 2026-02-17T08:21:15.582 INFO:tasks.workunit.client.0.trial059.stdout: "acting_primary": 3, 2026-02-17T08:21:15.582 INFO:tasks.workunit.client.0.trial059.stdout: "purged_snaps": [] 2026-02-17T08:21:15.582 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:21:15.582 INFO:tasks.workunit.client.0.trial059.stdout: "empty": 0, 2026-02-17T08:21:15.582 INFO:tasks.workunit.client.0.trial059.stdout: "dne": 0, 2026-02-17T08:21:15.582 INFO:tasks.workunit.client.0.trial059.stdout: "incomplete": 0, 2026-02-17T08:21:15.582 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_started": 55, 2026-02-17T08:21:15.582 INFO:tasks.workunit.client.0.trial059.stdout: "hit_set_history": { 2026-02-17T08:21:15.582 INFO:tasks.workunit.client.0.trial059.stdout: "current_last_update": "0'0", 2026-02-17T08:21:15.582 INFO:tasks.workunit.client.0.trial059.stdout: "history": [] 2026-02-17T08:21:15.583 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:21:15.583 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:21:15.583 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:21:15.583 INFO:tasks.workunit.client.0.trial059.stdout: "peer": "1(1)", 2026-02-17T08:21:15.583 INFO:tasks.workunit.client.0.trial059.stdout: "pgid": "2.0s1", 2026-02-17T08:21:15.583 INFO:tasks.workunit.client.0.trial059.stdout: "shared": "1", 2026-02-17T08:21:15.583 INFO:tasks.workunit.client.0.trial059.stdout: "last_update": "45'301", 2026-02-17T08:21:15.583 INFO:tasks.workunit.client.0.trial059.stdout: "last_complete": "45'301", 2026-02-17T08:21:15.583 INFO:tasks.workunit.client.0.trial059.stdout: "log_tail": "45'200", 2026-02-17T08:21:15.583 INFO:tasks.workunit.client.0.trial059.stdout: "last_user_version": 301, 2026-02-17T08:21:15.583 INFO:tasks.workunit.client.0.trial059.stdout: "last_backfill": "MAX", 2026-02-17T08:21:15.583 INFO:tasks.workunit.client.0.trial059.stdout: "purged_snaps": [], 2026-02-17T08:21:15.584 INFO:tasks.workunit.client.0.trial059.stdout: "history": { 2026-02-17T08:21:15.584 INFO:tasks.workunit.client.0.trial059.stdout: "epoch_created": 39, 2026-02-17T08:21:15.584 INFO:tasks.workunit.client.0.trial059.stdout: "epoch_pool_created": 39, 2026-02-17T08:21:15.584 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_started": 55, 2026-02-17T08:21:15.584 INFO:tasks.workunit.client.0.trial059.stdout: "last_interval_started": 54, 2026-02-17T08:21:15.584 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_clean": 40, 2026-02-17T08:21:15.584 INFO:tasks.workunit.client.0.trial059.stdout: "last_interval_clean": 39, 2026-02-17T08:21:15.584 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_split": 0, 2026-02-17T08:21:15.584 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_marked_full": 0, 2026-02-17T08:21:15.584 INFO:tasks.workunit.client.0.trial059.stdout: "same_up_since": 54, 2026-02-17T08:21:15.584 INFO:tasks.workunit.client.0.trial059.stdout: "same_interval_since": 54, 2026-02-17T08:21:15.584 INFO:tasks.workunit.client.0.trial059.stdout: "same_primary_since": 39, 2026-02-17T08:21:15.584 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub": "0'0", 2026-02-17T08:21:15.585 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_stamp": "2026-02-17T08:20:33.048557+0000", 2026-02-17T08:21:15.585 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub": "0'0", 2026-02-17T08:21:15.585 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub_stamp": "2026-02-17T08:20:33.048557+0000", 2026-02-17T08:21:15.585 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean_scrub_stamp": "2026-02-17T08:20:33.048557+0000", 2026-02-17T08:21:15.585 INFO:tasks.workunit.client.0.trial059.stdout: "prior_readable_until_ub": 0 2026-02-17T08:21:15.585 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:21:15.585 INFO:tasks.workunit.client.0.trial059.stdout: "stats": { 2026-02-17T08:21:15.585 INFO:tasks.workunit.client.0.trial059.stdout: "version": "45'301", 2026-02-17T08:21:15.585 INFO:tasks.workunit.client.0.trial059.stdout: "reported_seq": 329, 2026-02-17T08:21:15.585 INFO:tasks.workunit.client.0.trial059.stdout: "reported_epoch": 45, 2026-02-17T08:21:15.585 INFO:tasks.workunit.client.0.trial059.stdout: "state": "active+undersized+degraded", 2026-02-17T08:21:15.585 INFO:tasks.workunit.client.0.trial059.stdout: "last_fresh": "2026-02-17T08:20:47.374605+0000", 2026-02-17T08:21:15.586 INFO:tasks.workunit.client.0.trial059.stdout: "last_change": "2026-02-17T08:20:38.515127+0000", 2026-02-17T08:21:15.586 INFO:tasks.workunit.client.0.trial059.stdout: "last_active": "2026-02-17T08:20:47.374605+0000", 2026-02-17T08:21:15.586 INFO:tasks.workunit.client.0.trial059.stdout: "last_peered": "2026-02-17T08:20:47.374605+0000", 2026-02-17T08:21:15.586 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean": "2026-02-17T08:20:37.948266+0000", 2026-02-17T08:21:15.586 INFO:tasks.workunit.client.0.trial059.stdout: "last_became_active": "2026-02-17T08:20:38.515127+0000", 2026-02-17T08:21:15.586 INFO:tasks.workunit.client.0.trial059.stdout: "last_became_peered": "2026-02-17T08:20:38.515127+0000", 2026-02-17T08:21:15.586 INFO:tasks.workunit.client.0.trial059.stdout: "last_unstale": "2026-02-17T08:20:47.374605+0000", 2026-02-17T08:21:15.586 INFO:tasks.workunit.client.0.trial059.stdout: "last_undegraded": "2026-02-17T08:20:38.513125+0000", 2026-02-17T08:21:15.586 INFO:tasks.workunit.client.0.trial059.stdout: "last_fullsized": "2026-02-17T08:20:38.513018+0000", 2026-02-17T08:21:15.586 INFO:tasks.workunit.client.0.trial059.stdout: "mapping_epoch": 54, 2026-02-17T08:21:15.586 INFO:tasks.workunit.client.0.trial059.stdout: "log_start": "45'200", 2026-02-17T08:21:15.586 INFO:tasks.workunit.client.0.trial059.stdout: "ondisk_log_start": "45'200", 2026-02-17T08:21:15.586 INFO:tasks.workunit.client.0.trial059.stdout: "created": 39, 2026-02-17T08:21:15.587 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_clean": 40, 2026-02-17T08:21:15.587 INFO:tasks.workunit.client.0.trial059.stdout: "parent": "0.0", 2026-02-17T08:21:15.587 INFO:tasks.workunit.client.0.trial059.stdout: "parent_split_bits": 0, 2026-02-17T08:21:15.587 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub": "0'0", 2026-02-17T08:21:15.587 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_stamp": "2026-02-17T08:20:33.048557+0000", 2026-02-17T08:21:15.587 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub": "0'0", 2026-02-17T08:21:15.587 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub_stamp": "2026-02-17T08:20:33.048557+0000", 2026-02-17T08:21:15.587 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean_scrub_stamp": "2026-02-17T08:20:33.048557+0000", 2026-02-17T08:21:15.587 INFO:tasks.workunit.client.0.trial059.stdout: "objects_scrubbed": 0, 2026-02-17T08:21:15.587 INFO:tasks.workunit.client.0.trial059.stdout: "log_size": 101, 2026-02-17T08:21:15.587 INFO:tasks.workunit.client.0.trial059.stdout: "log_dups_size": 200, 2026-02-17T08:21:15.587 INFO:tasks.workunit.client.0.trial059.stdout: "ondisk_log_size": 101, 2026-02-17T08:21:15.587 INFO:tasks.workunit.client.0.trial059.stdout: "stats_invalid": false, 2026-02-17T08:21:15.588 INFO:tasks.workunit.client.0.trial059.stdout: "dirty_stats_invalid": false, 2026-02-17T08:21:15.588 INFO:tasks.workunit.client.0.trial059.stdout: "omap_stats_invalid": false, 2026-02-17T08:21:15.588 INFO:tasks.workunit.client.0.trial059.stdout: "hitset_stats_invalid": false, 2026-02-17T08:21:15.588 INFO:tasks.workunit.client.0.trial059.stdout: "hitset_bytes_stats_invalid": false, 2026-02-17T08:21:15.588 INFO:tasks.workunit.client.0.trial059.stdout: "pin_stats_invalid": false, 2026-02-17T08:21:15.588 INFO:tasks.workunit.client.0.trial059.stdout: "manifest_stats_invalid": false, 2026-02-17T08:21:15.588 INFO:tasks.workunit.client.0.trial059.stdout: "snaptrimq_len": 0, 2026-02-17T08:21:15.588 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_duration": 0, 2026-02-17T08:21:15.588 INFO:tasks.workunit.client.0.trial059.stdout: "scrub_schedule": "periodic scrub scheduled @ 2026-02-18T11:31:01.420451+0000", 2026-02-17T08:21:15.588 INFO:tasks.workunit.client.0.trial059.stdout: "scrub_duration": 0, 2026-02-17T08:21:15.588 INFO:tasks.workunit.client.0.trial059.stdout: "objects_trimmed": 0, 2026-02-17T08:21:15.588 INFO:tasks.workunit.client.0.trial059.stdout: "snaptrim_duration": 0, 2026-02-17T08:21:15.588 INFO:tasks.workunit.client.0.trial059.stdout: "stat_sum": { 2026-02-17T08:21:15.589 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes": 1232896, 2026-02-17T08:21:15.589 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects": 301, 2026-02-17T08:21:15.589 INFO:tasks.workunit.client.0.trial059.stdout: "num_object_clones": 0, 2026-02-17T08:21:15.589 INFO:tasks.workunit.client.0.trial059.stdout: "num_object_copies": 1505, 2026-02-17T08:21:15.589 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T08:21:15.589 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_missing": 1, 2026-02-17T08:21:15.589 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_degraded": 301, 2026-02-17T08:21:15.589 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_misplaced": 0, 2026-02-17T08:21:15.589 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_unfound": 0, 2026-02-17T08:21:15.589 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_dirty": 301, 2026-02-17T08:21:15.589 INFO:tasks.workunit.client.0.trial059.stdout: "num_whiteouts": 0, 2026-02-17T08:21:15.589 INFO:tasks.workunit.client.0.trial059.stdout: "num_read": 0, 2026-02-17T08:21:15.589 INFO:tasks.workunit.client.0.trial059.stdout: "num_read_kb": 0, 2026-02-17T08:21:15.589 INFO:tasks.workunit.client.0.trial059.stdout: "num_write": 301, 2026-02-17T08:21:15.589 INFO:tasks.workunit.client.0.trial059.stdout: "num_write_kb": 1204, 2026-02-17T08:21:15.590 INFO:tasks.workunit.client.0.trial059.stdout: "num_scrub_errors": 0, 2026-02-17T08:21:15.590 INFO:tasks.workunit.client.0.trial059.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T08:21:15.590 INFO:tasks.workunit.client.0.trial059.stdout: "num_deep_scrub_errors": 0, 2026-02-17T08:21:15.590 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_recovered": 0, 2026-02-17T08:21:15.590 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes_recovered": 0, 2026-02-17T08:21:15.590 INFO:tasks.workunit.client.0.trial059.stdout: "num_keys_recovered": 0, 2026-02-17T08:21:15.590 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_omap": 0, 2026-02-17T08:21:15.590 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T08:21:15.590 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T08:21:15.590 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush": 0, 2026-02-17T08:21:15.590 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_kb": 0, 2026-02-17T08:21:15.590 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict": 0, 2026-02-17T08:21:15.590 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_kb": 0, 2026-02-17T08:21:15.590 INFO:tasks.workunit.client.0.trial059.stdout: "num_promote": 0, 2026-02-17T08:21:15.590 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_mode_high": 0, 2026-02-17T08:21:15.591 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_mode_low": 0, 2026-02-17T08:21:15.591 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_mode_some": 0, 2026-02-17T08:21:15.591 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_mode_full": 0, 2026-02-17T08:21:15.591 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_pinned": 0, 2026-02-17T08:21:15.591 INFO:tasks.workunit.client.0.trial059.stdout: "num_legacy_snapsets": 0, 2026-02-17T08:21:15.591 INFO:tasks.workunit.client.0.trial059.stdout: "num_large_omap_objects": 0, 2026-02-17T08:21:15.591 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_manifest": 0, 2026-02-17T08:21:15.591 INFO:tasks.workunit.client.0.trial059.stdout: "num_omap_bytes": 0, 2026-02-17T08:21:15.591 INFO:tasks.workunit.client.0.trial059.stdout: "num_omap_keys": 0, 2026-02-17T08:21:15.591 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_repaired": 0 2026-02-17T08:21:15.591 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:21:15.591 INFO:tasks.workunit.client.0.trial059.stdout: "up": [ 2026-02-17T08:21:15.591 INFO:tasks.workunit.client.0.trial059.stdout: 3, 2026-02-17T08:21:15.591 INFO:tasks.workunit.client.0.trial059.stdout: 1, 2026-02-17T08:21:15.592 INFO:tasks.workunit.client.0.trial059.stdout: 4, 2026-02-17T08:21:15.592 INFO:tasks.workunit.client.0.trial059.stdout: 0, 2026-02-17T08:21:15.592 INFO:tasks.workunit.client.0.trial059.stdout: 2147483647 2026-02-17T08:21:15.592 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:21:15.592 INFO:tasks.workunit.client.0.trial059.stdout: "acting": [ 2026-02-17T08:21:15.592 INFO:tasks.workunit.client.0.trial059.stdout: 3, 2026-02-17T08:21:15.592 INFO:tasks.workunit.client.0.trial059.stdout: 1, 2026-02-17T08:21:15.592 INFO:tasks.workunit.client.0.trial059.stdout: 4, 2026-02-17T08:21:15.592 INFO:tasks.workunit.client.0.trial059.stdout: 0, 2026-02-17T08:21:15.592 INFO:tasks.workunit.client.0.trial059.stdout: 2147483647 2026-02-17T08:21:15.592 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:21:15.592 INFO:tasks.workunit.client.0.trial059.stdout: "avail_no_missing": [ 2026-02-17T08:21:15.592 INFO:tasks.workunit.client.0.trial059.stdout: "3(0)", 2026-02-17T08:21:15.592 INFO:tasks.workunit.client.0.trial059.stdout: "0(3)", 2026-02-17T08:21:15.592 INFO:tasks.workunit.client.0.trial059.stdout: "1(1)", 2026-02-17T08:21:15.593 INFO:tasks.workunit.client.0.trial059.stdout: "4(2)" 2026-02-17T08:21:15.593 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:21:15.593 INFO:tasks.workunit.client.0.trial059.stdout: "object_location_counts": [ 2026-02-17T08:21:15.593 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:21:15.593 INFO:tasks.workunit.client.0.trial059.stdout: "shards": "0(3),1(1),3(0),4(2)", 2026-02-17T08:21:15.593 INFO:tasks.workunit.client.0.trial059.stdout: "objects": 301 2026-02-17T08:21:15.593 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:21:15.593 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:21:15.593 INFO:tasks.workunit.client.0.trial059.stdout: "blocked_by": [], 2026-02-17T08:21:15.593 INFO:tasks.workunit.client.0.trial059.stdout: "up_primary": 3, 2026-02-17T08:21:15.593 INFO:tasks.workunit.client.0.trial059.stdout: "acting_primary": 3, 2026-02-17T08:21:15.593 INFO:tasks.workunit.client.0.trial059.stdout: "purged_snaps": [] 2026-02-17T08:21:15.593 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:21:15.593 INFO:tasks.workunit.client.0.trial059.stdout: "empty": 0, 2026-02-17T08:21:15.593 INFO:tasks.workunit.client.0.trial059.stdout: "dne": 0, 2026-02-17T08:21:15.593 INFO:tasks.workunit.client.0.trial059.stdout: "incomplete": 0, 2026-02-17T08:21:15.593 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_started": 55, 2026-02-17T08:21:15.594 INFO:tasks.workunit.client.0.trial059.stdout: "hit_set_history": { 2026-02-17T08:21:15.594 INFO:tasks.workunit.client.0.trial059.stdout: "current_last_update": "0'0", 2026-02-17T08:21:15.594 INFO:tasks.workunit.client.0.trial059.stdout: "history": [] 2026-02-17T08:21:15.594 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:21:15.594 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:21:15.594 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:21:15.594 INFO:tasks.workunit.client.0.trial059.stdout: "peer": "4(2)", 2026-02-17T08:21:15.594 INFO:tasks.workunit.client.0.trial059.stdout: "pgid": "2.0s2", 2026-02-17T08:21:15.594 INFO:tasks.workunit.client.0.trial059.stdout: "shared": "2", 2026-02-17T08:21:15.594 INFO:tasks.workunit.client.0.trial059.stdout: "last_update": "45'301", 2026-02-17T08:21:15.594 INFO:tasks.workunit.client.0.trial059.stdout: "last_complete": "45'301", 2026-02-17T08:21:15.594 INFO:tasks.workunit.client.0.trial059.stdout: "log_tail": "45'200", 2026-02-17T08:21:15.594 INFO:tasks.workunit.client.0.trial059.stdout: "last_user_version": 301, 2026-02-17T08:21:15.594 INFO:tasks.workunit.client.0.trial059.stdout: "last_backfill": "MAX", 2026-02-17T08:21:15.594 INFO:tasks.workunit.client.0.trial059.stdout: "purged_snaps": [], 2026-02-17T08:21:15.594 INFO:tasks.workunit.client.0.trial059.stdout: "history": { 2026-02-17T08:21:15.595 INFO:tasks.workunit.client.0.trial059.stdout: "epoch_created": 39, 2026-02-17T08:21:15.595 INFO:tasks.workunit.client.0.trial059.stdout: "epoch_pool_created": 39, 2026-02-17T08:21:15.595 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_started": 55, 2026-02-17T08:21:15.595 INFO:tasks.workunit.client.0.trial059.stdout: "last_interval_started": 54, 2026-02-17T08:21:15.595 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_clean": 40, 2026-02-17T08:21:15.595 INFO:tasks.workunit.client.0.trial059.stdout: "last_interval_clean": 39, 2026-02-17T08:21:15.595 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_split": 0, 2026-02-17T08:21:15.595 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_marked_full": 0, 2026-02-17T08:21:15.595 INFO:tasks.workunit.client.0.trial059.stdout: "same_up_since": 54, 2026-02-17T08:21:15.595 INFO:tasks.workunit.client.0.trial059.stdout: "same_interval_since": 54, 2026-02-17T08:21:15.595 INFO:tasks.workunit.client.0.trial059.stdout: "same_primary_since": 39, 2026-02-17T08:21:15.595 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub": "0'0", 2026-02-17T08:21:15.595 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_stamp": "2026-02-17T08:20:33.048557+0000", 2026-02-17T08:21:15.595 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub": "0'0", 2026-02-17T08:21:15.595 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub_stamp": "2026-02-17T08:20:33.048557+0000", 2026-02-17T08:21:15.595 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean_scrub_stamp": "2026-02-17T08:20:33.048557+0000", 2026-02-17T08:21:15.596 INFO:tasks.workunit.client.0.trial059.stdout: "prior_readable_until_ub": 0 2026-02-17T08:21:15.596 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:21:15.596 INFO:tasks.workunit.client.0.trial059.stdout: "stats": { 2026-02-17T08:21:15.596 INFO:tasks.workunit.client.0.trial059.stdout: "version": "45'301", 2026-02-17T08:21:15.596 INFO:tasks.workunit.client.0.trial059.stdout: "reported_seq": 329, 2026-02-17T08:21:15.596 INFO:tasks.workunit.client.0.trial059.stdout: "reported_epoch": 45, 2026-02-17T08:21:15.596 INFO:tasks.workunit.client.0.trial059.stdout: "state": "active+undersized+degraded", 2026-02-17T08:21:15.596 INFO:tasks.workunit.client.0.trial059.stdout: "last_fresh": "2026-02-17T08:20:47.374605+0000", 2026-02-17T08:21:15.596 INFO:tasks.workunit.client.0.trial059.stdout: "last_change": "2026-02-17T08:20:38.515127+0000", 2026-02-17T08:21:15.596 INFO:tasks.workunit.client.0.trial059.stdout: "last_active": "2026-02-17T08:20:47.374605+0000", 2026-02-17T08:21:15.596 INFO:tasks.workunit.client.0.trial059.stdout: "last_peered": "2026-02-17T08:20:47.374605+0000", 2026-02-17T08:21:15.596 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean": "2026-02-17T08:20:37.948266+0000", 2026-02-17T08:21:15.596 INFO:tasks.workunit.client.0.trial059.stdout: "last_became_active": "2026-02-17T08:20:38.515127+0000", 2026-02-17T08:21:15.596 INFO:tasks.workunit.client.0.trial059.stdout: "last_became_peered": "2026-02-17T08:20:38.515127+0000", 2026-02-17T08:21:15.596 INFO:tasks.workunit.client.0.trial059.stdout: "last_unstale": "2026-02-17T08:20:47.374605+0000", 2026-02-17T08:21:15.596 INFO:tasks.workunit.client.0.trial059.stdout: "last_undegraded": "2026-02-17T08:20:38.513125+0000", 2026-02-17T08:21:15.596 INFO:tasks.workunit.client.0.trial059.stdout: "last_fullsized": "2026-02-17T08:20:38.513018+0000", 2026-02-17T08:21:15.597 INFO:tasks.workunit.client.0.trial059.stdout: "mapping_epoch": 54, 2026-02-17T08:21:15.597 INFO:tasks.workunit.client.0.trial059.stdout: "log_start": "45'200", 2026-02-17T08:21:15.597 INFO:tasks.workunit.client.0.trial059.stdout: "ondisk_log_start": "45'200", 2026-02-17T08:21:15.597 INFO:tasks.workunit.client.0.trial059.stdout: "created": 39, 2026-02-17T08:21:15.597 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_clean": 40, 2026-02-17T08:21:15.597 INFO:tasks.workunit.client.0.trial059.stdout: "parent": "0.0", 2026-02-17T08:21:15.597 INFO:tasks.workunit.client.0.trial059.stdout: "parent_split_bits": 0, 2026-02-17T08:21:15.597 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub": "0'0", 2026-02-17T08:21:15.597 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_stamp": "2026-02-17T08:20:33.048557+0000", 2026-02-17T08:21:15.597 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub": "0'0", 2026-02-17T08:21:15.597 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub_stamp": "2026-02-17T08:20:33.048557+0000", 2026-02-17T08:21:15.597 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean_scrub_stamp": "2026-02-17T08:20:33.048557+0000", 2026-02-17T08:21:15.597 INFO:tasks.workunit.client.0.trial059.stdout: "objects_scrubbed": 0, 2026-02-17T08:21:15.597 INFO:tasks.workunit.client.0.trial059.stdout: "log_size": 101, 2026-02-17T08:21:15.597 INFO:tasks.workunit.client.0.trial059.stdout: "log_dups_size": 200, 2026-02-17T08:21:15.597 INFO:tasks.workunit.client.0.trial059.stdout: "ondisk_log_size": 101, 2026-02-17T08:21:15.597 INFO:tasks.workunit.client.0.trial059.stdout: "stats_invalid": false, 2026-02-17T08:21:15.597 INFO:tasks.workunit.client.0.trial059.stdout: "dirty_stats_invalid": false, 2026-02-17T08:21:15.598 INFO:tasks.workunit.client.0.trial059.stdout: "omap_stats_invalid": false, 2026-02-17T08:21:15.598 INFO:tasks.workunit.client.0.trial059.stdout: "hitset_stats_invalid": false, 2026-02-17T08:21:15.598 INFO:tasks.workunit.client.0.trial059.stdout: "hitset_bytes_stats_invalid": false, 2026-02-17T08:21:15.598 INFO:tasks.workunit.client.0.trial059.stdout: "pin_stats_invalid": false, 2026-02-17T08:21:15.598 INFO:tasks.workunit.client.0.trial059.stdout: "manifest_stats_invalid": false, 2026-02-17T08:21:15.598 INFO:tasks.workunit.client.0.trial059.stdout: "snaptrimq_len": 0, 2026-02-17T08:21:15.598 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_duration": 0, 2026-02-17T08:21:15.598 INFO:tasks.workunit.client.0.trial059.stdout: "scrub_schedule": "periodic scrub scheduled @ 2026-02-18T11:31:01.420451+0000", 2026-02-17T08:21:15.598 INFO:tasks.workunit.client.0.trial059.stdout: "scrub_duration": 0, 2026-02-17T08:21:15.598 INFO:tasks.workunit.client.0.trial059.stdout: "objects_trimmed": 0, 2026-02-17T08:21:15.598 INFO:tasks.workunit.client.0.trial059.stdout: "snaptrim_duration": 0, 2026-02-17T08:21:15.598 INFO:tasks.workunit.client.0.trial059.stdout: "stat_sum": { 2026-02-17T08:21:15.598 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes": 1232896, 2026-02-17T08:21:15.598 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects": 301, 2026-02-17T08:21:15.598 INFO:tasks.workunit.client.0.trial059.stdout: "num_object_clones": 0, 2026-02-17T08:21:15.598 INFO:tasks.workunit.client.0.trial059.stdout: "num_object_copies": 1505, 2026-02-17T08:21:15.598 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T08:21:15.598 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_missing": 0, 2026-02-17T08:21:15.599 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_degraded": 301, 2026-02-17T08:21:15.599 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_misplaced": 0, 2026-02-17T08:21:15.599 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_unfound": 0, 2026-02-17T08:21:15.599 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_dirty": 301, 2026-02-17T08:21:15.599 INFO:tasks.workunit.client.0.trial059.stdout: "num_whiteouts": 0, 2026-02-17T08:21:15.599 INFO:tasks.workunit.client.0.trial059.stdout: "num_read": 0, 2026-02-17T08:21:15.599 INFO:tasks.workunit.client.0.trial059.stdout: "num_read_kb": 0, 2026-02-17T08:21:15.599 INFO:tasks.workunit.client.0.trial059.stdout: "num_write": 301, 2026-02-17T08:21:15.599 INFO:tasks.workunit.client.0.trial059.stdout: "num_write_kb": 1204, 2026-02-17T08:21:15.599 INFO:tasks.workunit.client.0.trial059.stdout: "num_scrub_errors": 0, 2026-02-17T08:21:15.599 INFO:tasks.workunit.client.0.trial059.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T08:21:15.599 INFO:tasks.workunit.client.0.trial059.stdout: "num_deep_scrub_errors": 0, 2026-02-17T08:21:15.599 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_recovered": 0, 2026-02-17T08:21:15.599 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes_recovered": 0, 2026-02-17T08:21:15.599 INFO:tasks.workunit.client.0.trial059.stdout: "num_keys_recovered": 0, 2026-02-17T08:21:15.599 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_omap": 0, 2026-02-17T08:21:15.599 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T08:21:15.599 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T08:21:15.600 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush": 0, 2026-02-17T08:21:15.600 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_kb": 0, 2026-02-17T08:21:15.600 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict": 0, 2026-02-17T08:21:15.600 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_kb": 0, 2026-02-17T08:21:15.600 INFO:tasks.workunit.client.0.trial059.stdout: "num_promote": 0, 2026-02-17T08:21:15.600 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_mode_high": 0, 2026-02-17T08:21:15.600 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_mode_low": 0, 2026-02-17T08:21:15.600 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_mode_some": 0, 2026-02-17T08:21:15.600 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_mode_full": 0, 2026-02-17T08:21:15.600 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_pinned": 0, 2026-02-17T08:21:15.600 INFO:tasks.workunit.client.0.trial059.stdout: "num_legacy_snapsets": 0, 2026-02-17T08:21:15.600 INFO:tasks.workunit.client.0.trial059.stdout: "num_large_omap_objects": 0, 2026-02-17T08:21:15.600 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_manifest": 0, 2026-02-17T08:21:15.600 INFO:tasks.workunit.client.0.trial059.stdout: "num_omap_bytes": 0, 2026-02-17T08:21:15.600 INFO:tasks.workunit.client.0.trial059.stdout: "num_omap_keys": 0, 2026-02-17T08:21:15.600 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_repaired": 0 2026-02-17T08:21:15.600 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:21:15.600 INFO:tasks.workunit.client.0.trial059.stdout: "up": [ 2026-02-17T08:21:15.601 INFO:tasks.workunit.client.0.trial059.stdout: 3, 2026-02-17T08:21:15.601 INFO:tasks.workunit.client.0.trial059.stdout: 1, 2026-02-17T08:21:15.601 INFO:tasks.workunit.client.0.trial059.stdout: 4, 2026-02-17T08:21:15.601 INFO:tasks.workunit.client.0.trial059.stdout: 0, 2026-02-17T08:21:15.601 INFO:tasks.workunit.client.0.trial059.stdout: 2147483647 2026-02-17T08:21:15.601 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:21:15.601 INFO:tasks.workunit.client.0.trial059.stdout: "acting": [ 2026-02-17T08:21:15.601 INFO:tasks.workunit.client.0.trial059.stdout: 3, 2026-02-17T08:21:15.601 INFO:tasks.workunit.client.0.trial059.stdout: 1, 2026-02-17T08:21:15.601 INFO:tasks.workunit.client.0.trial059.stdout: 4, 2026-02-17T08:21:15.601 INFO:tasks.workunit.client.0.trial059.stdout: 0, 2026-02-17T08:21:15.601 INFO:tasks.workunit.client.0.trial059.stdout: 2147483647 2026-02-17T08:21:15.601 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:21:15.601 INFO:tasks.workunit.client.0.trial059.stdout: "avail_no_missing": [ 2026-02-17T08:21:15.601 INFO:tasks.workunit.client.0.trial059.stdout: "3(0)", 2026-02-17T08:21:15.601 INFO:tasks.workunit.client.0.trial059.stdout: "0(3)", 2026-02-17T08:21:15.601 INFO:tasks.workunit.client.0.trial059.stdout: "1(1)", 2026-02-17T08:21:15.601 INFO:tasks.workunit.client.0.trial059.stdout: "4(2)" 2026-02-17T08:21:15.602 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:21:15.602 INFO:tasks.workunit.client.0.trial059.stdout: "object_location_counts": [ 2026-02-17T08:21:15.602 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:21:15.602 INFO:tasks.workunit.client.0.trial059.stdout: "shards": "0(3),1(1),3(0),4(2)", 2026-02-17T08:21:15.602 INFO:tasks.workunit.client.0.trial059.stdout: "objects": 301 2026-02-17T08:21:15.602 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:21:15.602 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:21:15.602 INFO:tasks.workunit.client.0.trial059.stdout: "blocked_by": [], 2026-02-17T08:21:15.602 INFO:tasks.workunit.client.0.trial059.stdout: "up_primary": 3, 2026-02-17T08:21:15.602 INFO:tasks.workunit.client.0.trial059.stdout: "acting_primary": 3, 2026-02-17T08:21:15.602 INFO:tasks.workunit.client.0.trial059.stdout: "purged_snaps": [] 2026-02-17T08:21:15.602 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:21:15.602 INFO:tasks.workunit.client.0.trial059.stdout: "empty": 0, 2026-02-17T08:21:15.602 INFO:tasks.workunit.client.0.trial059.stdout: "dne": 0, 2026-02-17T08:21:15.602 INFO:tasks.workunit.client.0.trial059.stdout: "incomplete": 0, 2026-02-17T08:21:15.602 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_started": 55, 2026-02-17T08:21:15.602 INFO:tasks.workunit.client.0.trial059.stdout: "hit_set_history": { 2026-02-17T08:21:15.602 INFO:tasks.workunit.client.0.trial059.stdout: "current_last_update": "0'0", 2026-02-17T08:21:15.603 INFO:tasks.workunit.client.0.trial059.stdout: "history": [] 2026-02-17T08:21:15.603 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:21:15.603 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:21:15.603 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:21:15.603 INFO:tasks.workunit.client.0.trial059.stdout: "recovery_state": [ 2026-02-17T08:21:15.603 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:21:15.603 INFO:tasks.workunit.client.0.trial059.stdout: "name": "Started/Primary/Active", 2026-02-17T08:21:15.603 INFO:tasks.workunit.client.0.trial059.stdout: "enter_time": "2026-02-17T08:21:09.015043+0000", 2026-02-17T08:21:15.603 INFO:tasks.workunit.client.0.trial059.stdout: "might_have_unfound": [ 2026-02-17T08:21:15.603 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:21:15.603 INFO:tasks.workunit.client.0.trial059.stdout: "osd": "0(3)", 2026-02-17T08:21:15.603 INFO:tasks.workunit.client.0.trial059.stdout: "status": "already probed" 2026-02-17T08:21:15.603 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:21:15.603 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:21:15.603 INFO:tasks.workunit.client.0.trial059.stdout: "osd": "1(1)", 2026-02-17T08:21:15.603 INFO:tasks.workunit.client.0.trial059.stdout: "status": "already probed" 2026-02-17T08:21:15.603 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:21:15.603 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:21:15.603 INFO:tasks.workunit.client.0.trial059.stdout: "osd": "2(4)", 2026-02-17T08:21:15.604 INFO:tasks.workunit.client.0.trial059.stdout: "status": "osd is down" 2026-02-17T08:21:15.604 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:21:15.604 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:21:15.604 INFO:tasks.workunit.client.0.trial059.stdout: "osd": "4(2)", 2026-02-17T08:21:15.604 INFO:tasks.workunit.client.0.trial059.stdout: "status": "already probed" 2026-02-17T08:21:15.604 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:21:15.604 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:21:15.604 INFO:tasks.workunit.client.0.trial059.stdout: "recovery_progress": { 2026-02-17T08:21:15.604 INFO:tasks.workunit.client.0.trial059.stdout: "backfill_targets": [], 2026-02-17T08:21:15.604 INFO:tasks.workunit.client.0.trial059.stdout: "waiting_on_backfill": [], 2026-02-17T08:21:15.604 INFO:tasks.workunit.client.0.trial059.stdout: "last_backfill_started": "MIN", 2026-02-17T08:21:15.604 INFO:tasks.workunit.client.0.trial059.stdout: "backfill_info": { 2026-02-17T08:21:15.604 INFO:tasks.workunit.client.0.trial059.stdout: "begin": "MIN", 2026-02-17T08:21:15.604 INFO:tasks.workunit.client.0.trial059.stdout: "end": "MIN", 2026-02-17T08:21:15.604 INFO:tasks.workunit.client.0.trial059.stdout: "objects": [] 2026-02-17T08:21:15.604 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:21:15.604 INFO:tasks.workunit.client.0.trial059.stdout: "peer_backfill_info": [], 2026-02-17T08:21:15.604 INFO:tasks.workunit.client.0.trial059.stdout: "backfills_in_flight": [], 2026-02-17T08:21:15.604 INFO:tasks.workunit.client.0.trial059.stdout: "recovering": [], 2026-02-17T08:21:15.604 INFO:tasks.workunit.client.0.trial059.stdout: "pg_backend": { 2026-02-17T08:21:15.604 INFO:tasks.workunit.client.0.trial059.stdout: "recovery_ops": [], 2026-02-17T08:21:15.604 INFO:tasks.workunit.client.0.trial059.stdout: "read_ops": [] 2026-02-17T08:21:15.605 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:21:15.605 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:21:15.605 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:21:15.605 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:21:15.605 INFO:tasks.workunit.client.0.trial059.stdout: "name": "Started", 2026-02-17T08:21:15.605 INFO:tasks.workunit.client.0.trial059.stdout: "enter_time": "2026-02-17T08:21:08.915702+0000" 2026-02-17T08:21:15.605 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:21:15.605 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:21:15.605 INFO:tasks.workunit.client.0.trial059.stdout: "scrubber": { 2026-02-17T08:21:15.605 INFO:tasks.workunit.client.0.trial059.stdout: "active": false, 2026-02-17T08:21:15.605 INFO:tasks.workunit.client.0.trial059.stdout: "must_scrub": false, 2026-02-17T08:21:15.605 INFO:tasks.workunit.client.0.trial059.stdout: "must_deep_scrub": false, 2026-02-17T08:21:15.605 INFO:tasks.workunit.client.0.trial059.stdout: "must_repair": false, 2026-02-17T08:21:15.605 INFO:tasks.workunit.client.0.trial059.stdout: "need_auto": false, 2026-02-17T08:21:15.605 INFO:tasks.workunit.client.0.trial059.stdout: "scrub_reg_stamp": "2026-02-18T14:36:00.920421+0000", 2026-02-17T08:21:15.605 INFO:tasks.workunit.client.0.trial059.stdout: "schedule": "no scrub is scheduled" 2026-02-17T08:21:15.605 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:21:15.605 INFO:tasks.workunit.client.0.trial059.stdout: "agent_state": {} 2026-02-17T08:21:15.605 INFO:tasks.workunit.client.0.trial059.stdout:} 2026-02-17T08:21:15.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:570: TEST_ec_backfill_unfound: ceph pg 2.0 list_unfound 2026-02-17T08:21:15.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:570: TEST_ec_backfill_unfound: grep -q obj250 2026-02-17T08:21:15.647 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:572: TEST_ec_backfill_unfound: ceph pg 2.0 list_unfound 2026-02-17T08:21:15.647 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:572: TEST_ec_backfill_unfound: jq .available_might_have_unfound 2026-02-17T08:21:15.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:572: TEST_ec_backfill_unfound: check=true 2026-02-17T08:21:15.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:573: TEST_ec_backfill_unfound: test true == true 2026-02-17T08:21:15.728 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:575: TEST_ec_backfill_unfound: ceph pg 2.0 list_unfound 2026-02-17T08:21:15.728 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:575: TEST_ec_backfill_unfound: jq '.might_have_unfound[0].status' 2026-02-17T08:21:15.804 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:575: TEST_ec_backfill_unfound: eval 'check="osd' is 'down"' 2026-02-17T08:21:15.804 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:575: TEST_ec_backfill_unfound: check='osd is down' 2026-02-17T08:21:15.804 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:576: TEST_ec_backfill_unfound: test 'osd is down' == 'osd is down' 2026-02-17T08:21:15.805 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:578: TEST_ec_backfill_unfound: ceph pg 2.0 list_unfound 2026-02-17T08:21:15.805 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:578: TEST_ec_backfill_unfound: jq '.might_have_unfound[0].osd' 2026-02-17T08:21:15.884 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:578: TEST_ec_backfill_unfound: eval 'check="2(4)"' 2026-02-17T08:21:15.884 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:578: TEST_ec_backfill_unfound: check='2(4)' 2026-02-17T08:21:15.884 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:579: TEST_ec_backfill_unfound: test '2(4)' == '2(4)' 2026-02-17T08:21:15.884 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:581: TEST_ec_backfill_unfound: activate_osd td/test-erasure-eio 2 2026-02-17T08:21:15.884 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-eio 2026-02-17T08:21:15.884 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:21:15.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=2 2026-02-17T08:21:15.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:21:15.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-17T08:21:15.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:21:15.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:21:15.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:21:15.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:21:15.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-17T08:21:15.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-17T08:21:15.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:21:15.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:21:15.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:21:15.886 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:21:15.886 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:21:15.886 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:21:15.886 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:21:15.886 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:21:15.886 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:21:15.886 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:21:15.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:21:15.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:21:15.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:21:15.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:21:15.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:21:15.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:21:15.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:21:15.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:21:15.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:21:15.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:21:15.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-17T08:21:15.887 INFO:tasks.workunit.client.0.trial059.stdout:start osd.2 2026-02-17T08:21:15.888 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.2 2026-02-17T08:21:15.888 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:21:15.889 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-17T08:21:15.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 2 = 2 ']' 2026-02-17T08:21:15.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:21:15.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:21:15.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:21:15.901 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:15.896+0000 7f79e6b038c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:21:15.902 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:15.896+0000 7f79e6b038c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:21:15.903 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:15.896+0000 7f79e6b038c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:21:16.086 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 2 2026-02-17T08:21:16.086 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:21:16.086 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:21:16.086 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:21:16.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:21:16.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:21:16.087 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:21:16.088 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:21:16.088 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:21:16.088 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:21:16.283 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:21:17.178 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:17.172+0000 7f79e6b038c0 -1 Falling back to public interface 2026-02-17T08:21:17.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:21:17.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:21:17.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:21:17.285 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:21:17.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:21:17.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:21:17.476 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:21:18.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:21:18.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:21:18.478 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:21:18.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:21:18.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:21:18.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:21:18.671 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:21:19.673 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:21:19.673 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:21:19.673 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:21:19.673 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:21:19.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:21:19.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:21:19.868 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:21:20.230 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:20.224+0000 7f79e6b038c0 -1 osd.2 53 log_to_monitors true 2026-02-17T08:21:20.869 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:21:20.869 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:21:20.870 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:21:20.870 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:21:20.870 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:21:20.871 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:21:21.063 INFO:tasks.workunit.client.0.trial059.stdout:osd.2 up in weight 1 up_from 57 up_thru 20 down_at 54 last_clean_interval [47,53) [v2:127.0.0.1:6818/2837840747,v1:127.0.0.1:6819/2837840747] [v2:127.0.0.1:6820/2837840747,v1:127.0.0.1:6821/2837840747] exists,up a8783306-78d4-4e86-93a3-d040cbb2bd26 2026-02-17T08:21:21.064 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:21:21.064 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:21:21.064 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:21:21.064 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:584: TEST_ec_backfill_unfound: timeout 5 rados -p pool-jerasure get obj250 td/test-erasure-eio/CHECK 2026-02-17T08:21:26.069 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:585: TEST_ec_backfill_unfound: test 124 = 124 2026-02-17T08:21:26.069 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:587: TEST_ec_backfill_unfound: ceph pg 2.0 mark_unfound_lost delete 2026-02-17T08:21:26.139 INFO:tasks.workunit.client.0.trial059.stderr:pg has no unfound objects 2026-02-17T08:21:26.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:589: TEST_ec_backfill_unfound: wait_for_clean 2026-02-17T08:21:26.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:21:26.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:21:26.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:21:26.147 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:21:26.148 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:21:26.148 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:21:26.149 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:21:26.149 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:21:26.149 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:21:26.255 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:21:26.255 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:21:26.255 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:21:26.256 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:21:26.256 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:21:26.256 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:21:26.450 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:21:26.450 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:21:26.451 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:21:26.451 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:21:26.451 INFO:tasks.workunit.client.0.trial059.stderr:4' 2026-02-17T08:21:26.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:21:26.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:21:26.451 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:21:26.526 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803798 2026-02-17T08:21:26.526 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803798 2026-02-17T08:21:26.526 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803798' 2026-02-17T08:21:26.526 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:21:26.527 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:21:26.601 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=55834574868 2026-02-17T08:21:26.601 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 55834574868 2026-02-17T08:21:26.601 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803798 1-55834574868' 2026-02-17T08:21:26.602 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:21:26.602 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:21:26.677 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=244813135876 2026-02-17T08:21:26.677 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 244813135876 2026-02-17T08:21:26.677 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803798 1-55834574868 2-244813135876' 2026-02-17T08:21:26.678 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:21:26.678 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:21:26.751 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=111669149713 2026-02-17T08:21:26.751 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 111669149713 2026-02-17T08:21:26.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803798 1-55834574868 2-244813135876 3-111669149713' 2026-02-17T08:21:26.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:21:26.752 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:21:26.829 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=146028888079 2026-02-17T08:21:26.830 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 146028888079 2026-02-17T08:21:26.830 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803798 1-55834574868 2-244813135876 3-111669149713 4-146028888079' 2026-02-17T08:21:26.830 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:21:26.830 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803798 2026-02-17T08:21:26.830 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:21:26.831 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:21:26.832 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803798 2026-02-17T08:21:26.832 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:21:26.833 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803798 2026-02-17T08:21:26.834 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 25769803798 2026-02-17T08:21:26.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803798' 2026-02-17T08:21:26.834 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:21:27.030 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803796 -lt 25769803798 2026-02-17T08:21:27.030 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:21:28.031 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:21:28.031 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:21:28.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803798 -lt 25769803798 2026-02-17T08:21:28.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:21:28.230 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-55834574868 2026-02-17T08:21:28.230 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:21:28.231 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:21:28.231 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-55834574868 2026-02-17T08:21:28.232 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:21:28.233 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=55834574868 2026-02-17T08:21:28.233 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 55834574868' 2026-02-17T08:21:28.233 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 55834574868 2026-02-17T08:21:28.234 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:21:28.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 55834574869 -lt 55834574868 2026-02-17T08:21:28.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:21:28.428 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-244813135876 2026-02-17T08:21:28.428 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:21:28.429 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:21:28.429 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-244813135876 2026-02-17T08:21:28.430 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:21:28.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=244813135876 2026-02-17T08:21:28.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 244813135876' 2026-02-17T08:21:28.431 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 244813135876 2026-02-17T08:21:28.431 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:21:28.640 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 244813135876 -lt 244813135876 2026-02-17T08:21:28.640 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:21:28.641 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-111669149713 2026-02-17T08:21:28.641 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:21:28.642 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:21:28.642 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-111669149713 2026-02-17T08:21:28.642 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:21:28.644 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=111669149713 2026-02-17T08:21:28.644 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 111669149713 2026-02-17T08:21:28.645 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 111669149713' 2026-02-17T08:21:28.645 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:21:28.839 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 111669149713 -lt 111669149713 2026-02-17T08:21:28.839 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:21:28.840 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-146028888079 2026-02-17T08:21:28.840 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:21:28.841 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:21:28.841 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-146028888079 2026-02-17T08:21:28.841 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:21:28.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=146028888079 2026-02-17T08:21:28.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 146028888079' 2026-02-17T08:21:28.843 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.4 seq 146028888079 2026-02-17T08:21:28.844 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:21:29.040 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 146028888080 -lt 146028888079 2026-02-17T08:21:29.041 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:21:29.041 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:21:29.041 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:21:29.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:21:29.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:21:29.299 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:21:29.299 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:21:29.299 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:21:29.299 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:21:29.300 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:21:29.300 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:21:29.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:21:29.499 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:21:29.499 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:21:29.500 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:21:29.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:21:29.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:21:29.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:21:29.754 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: seq 1 300 2026-02-17T08:21:29.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:29.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj1 = obj250 ']' 2026-02-17T08:21:29.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj1 td/test-erasure-eio/CHECK 2026-02-17T08:21:29.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:29.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:29.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj2 = obj250 ']' 2026-02-17T08:21:29.775 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj2 td/test-erasure-eio/CHECK 2026-02-17T08:21:29.793 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:29.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:29.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj3 = obj250 ']' 2026-02-17T08:21:29.795 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj3 td/test-erasure-eio/CHECK 2026-02-17T08:21:29.818 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:29.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:29.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj4 = obj250 ']' 2026-02-17T08:21:29.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj4 td/test-erasure-eio/CHECK 2026-02-17T08:21:29.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:29.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:29.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj5 = obj250 ']' 2026-02-17T08:21:29.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj5 td/test-erasure-eio/CHECK 2026-02-17T08:21:29.866 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:29.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:29.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj6 = obj250 ']' 2026-02-17T08:21:29.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj6 td/test-erasure-eio/CHECK 2026-02-17T08:21:29.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:29.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:29.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj7 = obj250 ']' 2026-02-17T08:21:29.891 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj7 td/test-erasure-eio/CHECK 2026-02-17T08:21:29.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:29.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:29.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj8 = obj250 ']' 2026-02-17T08:21:29.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj8 td/test-erasure-eio/CHECK 2026-02-17T08:21:29.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:29.927 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:29.927 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj9 = obj250 ']' 2026-02-17T08:21:29.927 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj9 td/test-erasure-eio/CHECK 2026-02-17T08:21:29.947 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:29.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:29.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj10 = obj250 ']' 2026-02-17T08:21:29.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj10 td/test-erasure-eio/CHECK 2026-02-17T08:21:29.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:29.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:29.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj11 = obj250 ']' 2026-02-17T08:21:29.969 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj11 td/test-erasure-eio/CHECK 2026-02-17T08:21:29.989 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:29.990 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:29.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj12 = obj250 ']' 2026-02-17T08:21:29.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj12 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.014 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj13 = obj250 ']' 2026-02-17T08:21:30.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj13 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.033 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.033 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj14 = obj250 ']' 2026-02-17T08:21:30.033 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj14 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.052 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.053 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.053 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj15 = obj250 ']' 2026-02-17T08:21:30.053 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj15 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.078 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.080 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.080 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj16 = obj250 ']' 2026-02-17T08:21:30.080 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj16 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.102 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.103 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.103 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj17 = obj250 ']' 2026-02-17T08:21:30.104 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj17 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.128 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.128 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj18 = obj250 ']' 2026-02-17T08:21:30.128 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj18 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.145 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj19 = obj250 ']' 2026-02-17T08:21:30.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj19 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.164 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.165 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.165 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj20 = obj250 ']' 2026-02-17T08:21:30.165 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj20 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj21 = obj250 ']' 2026-02-17T08:21:30.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj21 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.205 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.206 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.206 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj22 = obj250 ']' 2026-02-17T08:21:30.206 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj22 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj23 = obj250 ']' 2026-02-17T08:21:30.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj23 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.249 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.250 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.251 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj24 = obj250 ']' 2026-02-17T08:21:30.251 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj24 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.272 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.272 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj25 = obj250 ']' 2026-02-17T08:21:30.272 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj25 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.294 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.295 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.295 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj26 = obj250 ']' 2026-02-17T08:21:30.295 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj26 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.317 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.318 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.318 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj27 = obj250 ']' 2026-02-17T08:21:30.318 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj27 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.340 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.340 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj28 = obj250 ']' 2026-02-17T08:21:30.340 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj28 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.362 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.364 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.364 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj29 = obj250 ']' 2026-02-17T08:21:30.364 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj29 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.385 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.386 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.387 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj30 = obj250 ']' 2026-02-17T08:21:30.387 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj30 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.407 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj31 = obj250 ']' 2026-02-17T08:21:30.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj31 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj32 = obj250 ']' 2026-02-17T08:21:30.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj32 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.455 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.455 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj33 = obj250 ']' 2026-02-17T08:21:30.455 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj33 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj34 = obj250 ']' 2026-02-17T08:21:30.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj34 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.501 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.502 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.502 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj35 = obj250 ']' 2026-02-17T08:21:30.502 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj35 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.526 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.528 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.528 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj36 = obj250 ']' 2026-02-17T08:21:30.528 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj36 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.550 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.552 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.552 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj37 = obj250 ']' 2026-02-17T08:21:30.552 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj37 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.574 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj38 = obj250 ']' 2026-02-17T08:21:30.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj38 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.597 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj39 = obj250 ']' 2026-02-17T08:21:30.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj39 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj40 = obj250 ']' 2026-02-17T08:21:30.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj40 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.640 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.641 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.641 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj41 = obj250 ']' 2026-02-17T08:21:30.641 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj41 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj42 = obj250 ']' 2026-02-17T08:21:30.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj42 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj43 = obj250 ']' 2026-02-17T08:21:30.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj43 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.708 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.708 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj44 = obj250 ']' 2026-02-17T08:21:30.708 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj44 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.731 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.731 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj45 = obj250 ']' 2026-02-17T08:21:30.731 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj45 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.751 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj46 = obj250 ']' 2026-02-17T08:21:30.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj46 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.771 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.772 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.772 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj47 = obj250 ']' 2026-02-17T08:21:30.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj47 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.795 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.796 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj48 = obj250 ']' 2026-02-17T08:21:30.796 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj48 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.818 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.820 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj49 = obj250 ']' 2026-02-17T08:21:30.820 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj49 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj50 = obj250 ']' 2026-02-17T08:21:30.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj50 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.866 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.868 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj51 = obj250 ']' 2026-02-17T08:21:30.868 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj51 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.891 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.891 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj52 = obj250 ']' 2026-02-17T08:21:30.891 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj52 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj53 = obj250 ']' 2026-02-17T08:21:30.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj53 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.933 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.935 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.935 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj54 = obj250 ']' 2026-02-17T08:21:30.935 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj54 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.958 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.959 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.959 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj55 = obj250 ']' 2026-02-17T08:21:30.959 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj55 td/test-erasure-eio/CHECK 2026-02-17T08:21:30.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:30.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:30.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj56 = obj250 ']' 2026-02-17T08:21:30.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj56 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj57 = obj250 ']' 2026-02-17T08:21:31.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj57 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.030 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.031 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.031 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj58 = obj250 ']' 2026-02-17T08:21:31.031 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj58 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.053 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.054 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.055 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj59 = obj250 ']' 2026-02-17T08:21:31.055 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj59 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.075 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.076 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.076 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj60 = obj250 ']' 2026-02-17T08:21:31.076 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj60 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.094 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj61 = obj250 ']' 2026-02-17T08:21:31.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj61 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj62 = obj250 ']' 2026-02-17T08:21:31.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj62 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.135 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj63 = obj250 ']' 2026-02-17T08:21:31.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj63 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.155 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.156 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.157 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj64 = obj250 ']' 2026-02-17T08:21:31.157 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj64 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj65 = obj250 ']' 2026-02-17T08:21:31.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj65 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.198 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.200 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.200 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj66 = obj250 ']' 2026-02-17T08:21:31.200 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj66 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.221 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.221 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj67 = obj250 ']' 2026-02-17T08:21:31.221 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj67 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.243 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.244 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.244 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj68 = obj250 ']' 2026-02-17T08:21:31.244 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj68 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.263 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.264 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.264 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj69 = obj250 ']' 2026-02-17T08:21:31.264 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj69 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.282 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj70 = obj250 ']' 2026-02-17T08:21:31.282 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj70 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.302 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.302 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj71 = obj250 ']' 2026-02-17T08:21:31.302 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj71 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.323 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj72 = obj250 ']' 2026-02-17T08:21:31.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj72 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.346 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.348 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj73 = obj250 ']' 2026-02-17T08:21:31.348 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj73 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.370 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj74 = obj250 ']' 2026-02-17T08:21:31.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj74 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.394 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.395 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.395 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj75 = obj250 ']' 2026-02-17T08:21:31.395 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj75 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.418 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.419 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.419 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj76 = obj250 ']' 2026-02-17T08:21:31.419 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj76 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.442 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.443 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.443 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj77 = obj250 ']' 2026-02-17T08:21:31.443 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj77 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.465 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.467 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.467 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj78 = obj250 ']' 2026-02-17T08:21:31.467 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj78 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.484 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.485 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.485 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj79 = obj250 ']' 2026-02-17T08:21:31.485 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj79 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.504 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.505 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.505 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj80 = obj250 ']' 2026-02-17T08:21:31.505 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj80 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.527 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.528 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.528 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj81 = obj250 ']' 2026-02-17T08:21:31.528 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj81 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.546 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.548 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.548 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj82 = obj250 ']' 2026-02-17T08:21:31.548 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj82 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.569 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.570 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj83 = obj250 ']' 2026-02-17T08:21:31.570 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj83 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.593 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.594 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj84 = obj250 ']' 2026-02-17T08:21:31.594 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj84 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.618 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.618 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj85 = obj250 ']' 2026-02-17T08:21:31.618 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj85 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.636 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.637 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.637 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj86 = obj250 ']' 2026-02-17T08:21:31.637 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj86 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj87 = obj250 ']' 2026-02-17T08:21:31.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj87 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.682 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj88 = obj250 ']' 2026-02-17T08:21:31.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj88 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.708 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.708 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj89 = obj250 ']' 2026-02-17T08:21:31.708 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj89 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.732 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.732 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj90 = obj250 ']' 2026-02-17T08:21:31.732 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj90 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj91 = obj250 ']' 2026-02-17T08:21:31.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj91 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj92 = obj250 ']' 2026-02-17T08:21:31.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj92 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.801 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.802 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.802 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj93 = obj250 ']' 2026-02-17T08:21:31.803 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj93 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.827 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.827 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj94 = obj250 ']' 2026-02-17T08:21:31.827 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj94 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.846 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.847 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.847 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj95 = obj250 ']' 2026-02-17T08:21:31.848 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj95 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.868 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.868 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj96 = obj250 ']' 2026-02-17T08:21:31.868 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj96 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj97 = obj250 ']' 2026-02-17T08:21:31.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj97 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj98 = obj250 ']' 2026-02-17T08:21:31.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj98 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.927 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj99 = obj250 ']' 2026-02-17T08:21:31.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj99 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj100 = obj250 ']' 2026-02-17T08:21:31.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj100 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj101 = obj250 ']' 2026-02-17T08:21:31.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj101 td/test-erasure-eio/CHECK 2026-02-17T08:21:31.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:31.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:31.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj102 = obj250 ']' 2026-02-17T08:21:31.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj102 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.014 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj103 = obj250 ']' 2026-02-17T08:21:32.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj103 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.040 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.040 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj104 = obj250 ']' 2026-02-17T08:21:32.040 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj104 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.062 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj105 = obj250 ']' 2026-02-17T08:21:32.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj105 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.085 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.086 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.086 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj106 = obj250 ']' 2026-02-17T08:21:32.086 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj106 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.110 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.111 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.111 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj107 = obj250 ']' 2026-02-17T08:21:32.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj107 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.135 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.135 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj108 = obj250 ']' 2026-02-17T08:21:32.135 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj108 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.157 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj109 = obj250 ']' 2026-02-17T08:21:32.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj109 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.181 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.182 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.182 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj110 = obj250 ']' 2026-02-17T08:21:32.182 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj110 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.202 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.203 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.204 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj111 = obj250 ']' 2026-02-17T08:21:32.204 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj111 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.226 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.226 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj112 = obj250 ']' 2026-02-17T08:21:32.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj112 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.247 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.248 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.248 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj113 = obj250 ']' 2026-02-17T08:21:32.248 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj113 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.269 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.270 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.270 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj114 = obj250 ']' 2026-02-17T08:21:32.270 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj114 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.291 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.292 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj115 = obj250 ']' 2026-02-17T08:21:32.292 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj115 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.313 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj116 = obj250 ']' 2026-02-17T08:21:32.315 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj116 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.335 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.336 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.336 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj117 = obj250 ']' 2026-02-17T08:21:32.336 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj117 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.357 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.359 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj118 = obj250 ']' 2026-02-17T08:21:32.359 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj118 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.376 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj119 = obj250 ']' 2026-02-17T08:21:32.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj119 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.396 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj120 = obj250 ']' 2026-02-17T08:21:32.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj120 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.419 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.420 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.420 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj121 = obj250 ']' 2026-02-17T08:21:32.420 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj121 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.442 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.444 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.444 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj122 = obj250 ']' 2026-02-17T08:21:32.444 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj122 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.466 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.467 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.467 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj123 = obj250 ']' 2026-02-17T08:21:32.467 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj123 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.490 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.492 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.492 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj124 = obj250 ']' 2026-02-17T08:21:32.492 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj124 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj125 = obj250 ']' 2026-02-17T08:21:32.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj125 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.537 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.538 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.538 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj126 = obj250 ']' 2026-02-17T08:21:32.538 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj126 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.561 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.563 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.563 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj127 = obj250 ']' 2026-02-17T08:21:32.563 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj127 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj128 = obj250 ']' 2026-02-17T08:21:32.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj128 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj129 = obj250 ']' 2026-02-17T08:21:32.612 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj129 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.634 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.635 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.635 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj130 = obj250 ']' 2026-02-17T08:21:32.636 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj130 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj131 = obj250 ']' 2026-02-17T08:21:32.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj131 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.673 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.673 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj132 = obj250 ']' 2026-02-17T08:21:32.673 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj132 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.698 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj133 = obj250 ']' 2026-02-17T08:21:32.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj133 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj134 = obj250 ']' 2026-02-17T08:21:32.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj134 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.739 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj135 = obj250 ']' 2026-02-17T08:21:32.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj135 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.759 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.760 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.760 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj136 = obj250 ']' 2026-02-17T08:21:32.760 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj136 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj137 = obj250 ']' 2026-02-17T08:21:32.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj137 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.797 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.798 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.798 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj138 = obj250 ']' 2026-02-17T08:21:32.798 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj138 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.820 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj139 = obj250 ']' 2026-02-17T08:21:32.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj139 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj140 = obj250 ']' 2026-02-17T08:21:32.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj140 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.866 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj141 = obj250 ']' 2026-02-17T08:21:32.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj141 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.888 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.888 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj142 = obj250 ']' 2026-02-17T08:21:32.888 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj142 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj143 = obj250 ']' 2026-02-17T08:21:32.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj143 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.931 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.932 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.932 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj144 = obj250 ']' 2026-02-17T08:21:32.932 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj144 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.955 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.955 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj145 = obj250 ']' 2026-02-17T08:21:32.955 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj145 td/test-erasure-eio/CHECK 2026-02-17T08:21:32.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:32.980 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:32.980 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj146 = obj250 ']' 2026-02-17T08:21:32.980 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj146 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.003 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.004 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.004 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj147 = obj250 ']' 2026-02-17T08:21:33.004 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj147 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.026 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj148 = obj250 ']' 2026-02-17T08:21:33.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj148 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.047 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.049 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.049 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj149 = obj250 ']' 2026-02-17T08:21:33.049 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj149 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.070 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj150 = obj250 ']' 2026-02-17T08:21:33.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj150 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.093 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj151 = obj250 ']' 2026-02-17T08:21:33.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj151 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.117 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj152 = obj250 ']' 2026-02-17T08:21:33.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj152 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj153 = obj250 ']' 2026-02-17T08:21:33.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj153 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.167 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.167 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj154 = obj250 ']' 2026-02-17T08:21:33.167 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj154 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.188 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj155 = obj250 ']' 2026-02-17T08:21:33.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj155 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.214 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.216 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.216 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj156 = obj250 ']' 2026-02-17T08:21:33.216 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj156 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj157 = obj250 ']' 2026-02-17T08:21:33.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj157 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.262 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.264 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.264 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj158 = obj250 ']' 2026-02-17T08:21:33.264 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj158 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj159 = obj250 ']' 2026-02-17T08:21:33.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj159 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.310 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.312 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.312 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj160 = obj250 ']' 2026-02-17T08:21:33.312 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj160 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.336 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.336 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj161 = obj250 ']' 2026-02-17T08:21:33.336 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj161 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj162 = obj250 ']' 2026-02-17T08:21:33.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj162 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj163 = obj250 ']' 2026-02-17T08:21:33.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj163 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.398 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.398 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj164 = obj250 ']' 2026-02-17T08:21:33.398 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj164 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.419 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.420 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.420 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj165 = obj250 ']' 2026-02-17T08:21:33.420 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj165 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.440 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.441 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.441 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj166 = obj250 ']' 2026-02-17T08:21:33.441 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj166 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.462 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.464 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.464 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj167 = obj250 ']' 2026-02-17T08:21:33.464 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj167 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.485 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.487 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.487 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj168 = obj250 ']' 2026-02-17T08:21:33.487 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj168 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.507 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.508 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.508 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj169 = obj250 ']' 2026-02-17T08:21:33.508 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj169 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.530 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj170 = obj250 ']' 2026-02-17T08:21:33.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj170 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.554 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj171 = obj250 ']' 2026-02-17T08:21:33.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj171 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.573 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.573 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj172 = obj250 ']' 2026-02-17T08:21:33.574 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj172 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.593 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.594 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj173 = obj250 ']' 2026-02-17T08:21:33.594 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj173 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.617 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj174 = obj250 ']' 2026-02-17T08:21:33.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj174 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.642 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.644 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.644 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj175 = obj250 ']' 2026-02-17T08:21:33.644 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj175 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.666 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj176 = obj250 ']' 2026-02-17T08:21:33.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj176 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.690 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.690 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj177 = obj250 ']' 2026-02-17T08:21:33.691 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj177 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.711 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj178 = obj250 ']' 2026-02-17T08:21:33.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj178 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.734 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj179 = obj250 ']' 2026-02-17T08:21:33.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj179 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.758 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.759 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.759 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj180 = obj250 ']' 2026-02-17T08:21:33.759 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj180 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj181 = obj250 ']' 2026-02-17T08:21:33.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj181 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.805 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj182 = obj250 ']' 2026-02-17T08:21:33.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj182 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.829 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.830 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.830 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj183 = obj250 ']' 2026-02-17T08:21:33.830 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj183 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.852 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.852 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj184 = obj250 ']' 2026-02-17T08:21:33.852 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj184 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.870 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.871 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.871 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj185 = obj250 ']' 2026-02-17T08:21:33.871 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj185 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.893 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.894 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.895 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj186 = obj250 ']' 2026-02-17T08:21:33.895 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj186 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.915 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.916 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.916 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj187 = obj250 ']' 2026-02-17T08:21:33.916 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj187 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.935 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.936 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.937 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj188 = obj250 ']' 2026-02-17T08:21:33.937 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj188 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.955 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj189 = obj250 ']' 2026-02-17T08:21:33.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj189 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:33.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:33.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj190 = obj250 ']' 2026-02-17T08:21:33.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj190 td/test-erasure-eio/CHECK 2026-02-17T08:21:33.999 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.000 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.000 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj191 = obj250 ']' 2026-02-17T08:21:34.000 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj191 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.025 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.025 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj192 = obj250 ']' 2026-02-17T08:21:34.025 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj192 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.044 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.044 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj193 = obj250 ']' 2026-02-17T08:21:34.044 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj193 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.064 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj194 = obj250 ']' 2026-02-17T08:21:34.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj194 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.088 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.088 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj195 = obj250 ']' 2026-02-17T08:21:34.088 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj195 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.106 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj196 = obj250 ']' 2026-02-17T08:21:34.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj196 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.129 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.130 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.130 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj197 = obj250 ']' 2026-02-17T08:21:34.131 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj197 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.154 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.155 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.155 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj198 = obj250 ']' 2026-02-17T08:21:34.155 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj198 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj199 = obj250 ']' 2026-02-17T08:21:34.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj199 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.202 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.203 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.204 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj200 = obj250 ']' 2026-02-17T08:21:34.204 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj200 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.226 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj201 = obj250 ']' 2026-02-17T08:21:34.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj201 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.249 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.251 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.251 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj202 = obj250 ']' 2026-02-17T08:21:34.251 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj202 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.274 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.275 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.275 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj203 = obj250 ']' 2026-02-17T08:21:34.275 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj203 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj204 = obj250 ']' 2026-02-17T08:21:34.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj204 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.323 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj205 = obj250 ']' 2026-02-17T08:21:34.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj205 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.349 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.349 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj206 = obj250 ']' 2026-02-17T08:21:34.349 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj206 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj207 = obj250 ']' 2026-02-17T08:21:34.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj207 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.395 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.396 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.396 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj208 = obj250 ']' 2026-02-17T08:21:34.396 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj208 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.416 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.416 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj209 = obj250 ']' 2026-02-17T08:21:34.416 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj209 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj210 = obj250 ']' 2026-02-17T08:21:34.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj210 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj211 = obj250 ']' 2026-02-17T08:21:34.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj211 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.475 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.476 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.476 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj212 = obj250 ']' 2026-02-17T08:21:34.476 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj212 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.500 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.500 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj213 = obj250 ']' 2026-02-17T08:21:34.500 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj213 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.517 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.518 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.518 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj214 = obj250 ']' 2026-02-17T08:21:34.518 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj214 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.537 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.538 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.538 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj215 = obj250 ']' 2026-02-17T08:21:34.538 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj215 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.560 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.560 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj216 = obj250 ']' 2026-02-17T08:21:34.560 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj216 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj217 = obj250 ']' 2026-02-17T08:21:34.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj217 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.607 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.607 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj218 = obj250 ']' 2026-02-17T08:21:34.607 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj218 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.627 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.629 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.629 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj219 = obj250 ']' 2026-02-17T08:21:34.629 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj219 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.651 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj220 = obj250 ']' 2026-02-17T08:21:34.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj220 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.675 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.676 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.676 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj221 = obj250 ']' 2026-02-17T08:21:34.677 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj221 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.694 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.695 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.695 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj222 = obj250 ']' 2026-02-17T08:21:34.695 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj222 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.714 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.714 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj223 = obj250 ']' 2026-02-17T08:21:34.714 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj223 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.734 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj224 = obj250 ']' 2026-02-17T08:21:34.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj224 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.757 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.759 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.759 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj225 = obj250 ']' 2026-02-17T08:21:34.759 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj225 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj226 = obj250 ']' 2026-02-17T08:21:34.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj226 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.805 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj227 = obj250 ']' 2026-02-17T08:21:34.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj227 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.829 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.830 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.831 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj228 = obj250 ']' 2026-02-17T08:21:34.831 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj228 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.853 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.854 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.854 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj229 = obj250 ']' 2026-02-17T08:21:34.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj229 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.877 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.879 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.879 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj230 = obj250 ']' 2026-02-17T08:21:34.879 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj230 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.898 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.899 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.899 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj231 = obj250 ']' 2026-02-17T08:21:34.899 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj231 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj232 = obj250 ']' 2026-02-17T08:21:34.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj232 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.939 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj233 = obj250 ']' 2026-02-17T08:21:34.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj233 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.959 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.960 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.960 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj234 = obj250 ']' 2026-02-17T08:21:34.960 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj234 td/test-erasure-eio/CHECK 2026-02-17T08:21:34.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:34.980 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:34.980 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj235 = obj250 ']' 2026-02-17T08:21:34.980 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj235 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.000 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.001 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.001 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj236 = obj250 ']' 2026-02-17T08:21:35.001 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj236 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj237 = obj250 ']' 2026-02-17T08:21:35.024 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj237 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.044 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.044 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj238 = obj250 ']' 2026-02-17T08:21:35.045 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj238 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.062 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj239 = obj250 ']' 2026-02-17T08:21:35.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj239 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.083 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.085 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.085 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj240 = obj250 ']' 2026-02-17T08:21:35.085 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj240 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj241 = obj250 ']' 2026-02-17T08:21:35.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj241 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.128 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj242 = obj250 ']' 2026-02-17T08:21:35.128 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj242 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj243 = obj250 ']' 2026-02-17T08:21:35.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj243 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.167 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.168 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.168 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj244 = obj250 ']' 2026-02-17T08:21:35.169 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj244 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj245 = obj250 ']' 2026-02-17T08:21:35.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj245 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.207 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.208 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.208 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj246 = obj250 ']' 2026-02-17T08:21:35.208 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj246 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.230 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.230 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj247 = obj250 ']' 2026-02-17T08:21:35.231 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj247 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.251 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj248 = obj250 ']' 2026-02-17T08:21:35.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj248 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.273 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.274 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.274 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj249 = obj250 ']' 2026-02-17T08:21:35.275 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj249 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.295 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.296 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.296 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj250 = obj250 ']' 2026-02-17T08:21:35.296 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:595: TEST_ec_backfill_unfound: rados -p pool-jerasure get obj250 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.311 INFO:tasks.workunit.client.0.trial059.stderr:error getting pool-jerasure/obj250: (2) No such file or directory 2026-02-17T08:21:35.313 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.313 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj251 = obj250 ']' 2026-02-17T08:21:35.313 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj251 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.335 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.336 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.336 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj252 = obj250 ']' 2026-02-17T08:21:35.336 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj252 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.356 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.356 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj253 = obj250 ']' 2026-02-17T08:21:35.356 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj253 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj254 = obj250 ']' 2026-02-17T08:21:35.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj254 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj255 = obj250 ']' 2026-02-17T08:21:35.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj255 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.423 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.424 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.424 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj256 = obj250 ']' 2026-02-17T08:21:35.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj256 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.447 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.448 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.448 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj257 = obj250 ']' 2026-02-17T08:21:35.448 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj257 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.470 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj258 = obj250 ']' 2026-02-17T08:21:35.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj258 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.490 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.491 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.491 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj259 = obj250 ']' 2026-02-17T08:21:35.491 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj259 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.511 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.512 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.512 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj260 = obj250 ']' 2026-02-17T08:21:35.512 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj260 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.533 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj261 = obj250 ']' 2026-02-17T08:21:35.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj261 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.556 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.556 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj262 = obj250 ']' 2026-02-17T08:21:35.556 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj262 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.574 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj263 = obj250 ']' 2026-02-17T08:21:35.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj263 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.595 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.596 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.596 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj264 = obj250 ']' 2026-02-17T08:21:35.596 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj264 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj265 = obj250 ']' 2026-02-17T08:21:35.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj265 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.636 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.638 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.638 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj266 = obj250 ']' 2026-02-17T08:21:35.638 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj266 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj267 = obj250 ']' 2026-02-17T08:21:35.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj267 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.688 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.688 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj268 = obj250 ']' 2026-02-17T08:21:35.688 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj268 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.711 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.711 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj269 = obj250 ']' 2026-02-17T08:21:35.711 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj269 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.733 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.734 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.734 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj270 = obj250 ']' 2026-02-17T08:21:35.734 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj270 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.757 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.757 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj271 = obj250 ']' 2026-02-17T08:21:35.757 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj271 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj272 = obj250 ']' 2026-02-17T08:21:35.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj272 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.805 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj273 = obj250 ']' 2026-02-17T08:21:35.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj273 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.829 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.831 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.831 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj274 = obj250 ']' 2026-02-17T08:21:35.831 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj274 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.854 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj275 = obj250 ']' 2026-02-17T08:21:35.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj275 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.878 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.879 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.879 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj276 = obj250 ']' 2026-02-17T08:21:35.879 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj276 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.903 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.903 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj277 = obj250 ']' 2026-02-17T08:21:35.903 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj277 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.925 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj278 = obj250 ']' 2026-02-17T08:21:35.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj278 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.946 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.947 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.947 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj279 = obj250 ']' 2026-02-17T08:21:35.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj279 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.969 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj280 = obj250 ']' 2026-02-17T08:21:35.969 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj280 td/test-erasure-eio/CHECK 2026-02-17T08:21:35.986 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:35.987 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:35.988 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj281 = obj250 ']' 2026-02-17T08:21:35.988 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj281 td/test-erasure-eio/CHECK 2026-02-17T08:21:36.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:36.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:36.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj282 = obj250 ']' 2026-02-17T08:21:36.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj282 td/test-erasure-eio/CHECK 2026-02-17T08:21:36.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:36.029 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:36.029 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj283 = obj250 ']' 2026-02-17T08:21:36.029 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj283 td/test-erasure-eio/CHECK 2026-02-17T08:21:36.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:36.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:36.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj284 = obj250 ']' 2026-02-17T08:21:36.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj284 td/test-erasure-eio/CHECK 2026-02-17T08:21:36.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:36.075 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:36.075 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj285 = obj250 ']' 2026-02-17T08:21:36.075 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj285 td/test-erasure-eio/CHECK 2026-02-17T08:21:36.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:36.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:36.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj286 = obj250 ']' 2026-02-17T08:21:36.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj286 td/test-erasure-eio/CHECK 2026-02-17T08:21:36.118 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:36.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:36.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj287 = obj250 ']' 2026-02-17T08:21:36.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj287 td/test-erasure-eio/CHECK 2026-02-17T08:21:36.138 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:36.139 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:36.139 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj288 = obj250 ']' 2026-02-17T08:21:36.139 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj288 td/test-erasure-eio/CHECK 2026-02-17T08:21:36.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:36.160 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:36.160 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj289 = obj250 ']' 2026-02-17T08:21:36.160 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj289 td/test-erasure-eio/CHECK 2026-02-17T08:21:36.176 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:36.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:36.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj290 = obj250 ']' 2026-02-17T08:21:36.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj290 td/test-erasure-eio/CHECK 2026-02-17T08:21:36.196 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:36.197 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:36.198 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj291 = obj250 ']' 2026-02-17T08:21:36.198 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj291 td/test-erasure-eio/CHECK 2026-02-17T08:21:36.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:36.219 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:36.219 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj292 = obj250 ']' 2026-02-17T08:21:36.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj292 td/test-erasure-eio/CHECK 2026-02-17T08:21:36.239 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:36.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:36.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj293 = obj250 ']' 2026-02-17T08:21:36.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj293 td/test-erasure-eio/CHECK 2026-02-17T08:21:36.258 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:36.258 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:36.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj294 = obj250 ']' 2026-02-17T08:21:36.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj294 td/test-erasure-eio/CHECK 2026-02-17T08:21:36.277 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:36.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:36.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj295 = obj250 ']' 2026-02-17T08:21:36.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj295 td/test-erasure-eio/CHECK 2026-02-17T08:21:36.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:36.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:36.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj296 = obj250 ']' 2026-02-17T08:21:36.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj296 td/test-erasure-eio/CHECK 2026-02-17T08:21:36.319 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:36.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:36.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj297 = obj250 ']' 2026-02-17T08:21:36.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj297 td/test-erasure-eio/CHECK 2026-02-17T08:21:36.337 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:36.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:36.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj298 = obj250 ']' 2026-02-17T08:21:36.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj298 td/test-erasure-eio/CHECK 2026-02-17T08:21:36.356 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:36.357 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:36.357 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj299 = obj250 ']' 2026-02-17T08:21:36.357 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj299 td/test-erasure-eio/CHECK 2026-02-17T08:21:36.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:36.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:591: TEST_ec_backfill_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:21:36.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:593: TEST_ec_backfill_unfound: '[' obj300 = obj250 ']' 2026-02-17T08:21:36.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:597: TEST_ec_backfill_unfound: rados --pool pool-jerasure get obj300 td/test-erasure-eio/CHECK 2026-02-17T08:21:36.399 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:598: TEST_ec_backfill_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:36.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:602: TEST_ec_backfill_unfound: rm -f td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:21:36.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:604: TEST_ec_backfill_unfound: delete_erasure_coded_pool pool-jerasure 2026-02-17T08:21:36.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:21:36.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-17T08:21:36.645 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' does not exist 2026-02-17T08:21:36.654 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-17T08:21:36.953 INFO:tasks.workunit.client.0.trial059.stderr:erasure-code-profile myprofile does not exist 2026-02-17T08:21:36.963 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-17T08:21:36.963 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:21:36.963 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:21:36.963 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:21:36.963 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:21:36.963 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:21:36.963 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:21:36.963 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:21:36.963 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:21:37.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:21:37.074 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:21:37.075 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:21:37.075 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:21:37.076 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:21:37.076 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:21:37.077 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:21:37.078 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:21:37.078 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:21:37.078 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:21:37.079 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:21:37.080 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:21:37.081 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:21:37.081 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:21:37.126 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:21:37.126 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:21:37.127 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:21:37.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:21:37.129 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:21:37.129 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:21:37.129 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-17T08:21:37.129 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-17T08:21:37.129 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-eio 2026-02-17T08:21:37.129 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-eio 2026-02-17T08:21:37.129 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:21:37.129 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:21:37.129 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:21:37.129 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:21:37.130 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:21:37.130 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:21:37.130 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:21:37.130 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:21:37.131 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:21:37.131 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:21:37.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:21:37.133 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:21:37.134 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:21:37.134 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:21:37.135 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:21:37.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:21:37.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:21:37.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:21:37.137 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:21:37.138 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:21:37.139 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:21:37.139 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:21:37.140 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:21:37.141 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:21:37.141 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:21:37.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:21:37.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:21:37.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:21:37.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-eio 2026-02-17T08:21:37.143 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:21:37.143 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:21:37.143 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:21:37.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.70936 2026-02-17T08:21:37.145 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:21:37.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:21:37.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:21:37.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-17T08:21:37.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-17T08:21:37.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-eio 2026-02-17T08:21:37.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:21:37.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:21:37.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:21:37.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-eio/a 2026-02-17T08:21:37.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-17T08:21:37.168 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:21:37.168 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:21:37.168 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:21:37.168 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:21:37.168 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:21:37.168 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:21:37.169 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:21:37.169 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T08:21:37.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:21:37.196 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:21:37.196 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:21:37.196 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:21:37.196 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:21:37.197 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:21:37.198 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:21:37.198 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:21:37.198 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:21:37.198 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:21:37.198 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:21:37.198 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:21:37.198 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:21:37.199 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:21:37.199 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get fsid 2026-02-17T08:21:37.252 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:21:37.252 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:21:37.252 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:21:37.252 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:21:37.253 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:21:37.254 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:21:37.254 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:21:37.254 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:21:37.254 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:21:37.254 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:21:37.254 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:21:37.254 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:21:37.254 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:21:37.254 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get mon_host 2026-02-17T08:21:37.307 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-17T08:21:37.307 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-eio 2026-02-17T08:21:37.307 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:21:37.308 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:21:37.308 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:21:37.308 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-eio/x 2026-02-17T08:21:37.308 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:21:37.414 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:21:37.414 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:21:37.414 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:21:37.414 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:21:37.414 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:21:37.415 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:21:37.415 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:21:37.415 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:21:37.416 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:21:37.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-17T08:21:37.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T08:21:37.540 INFO:tasks.workunit.client.0.trial059.stderr:pool 'rbd' already exists 2026-02-17T08:21:37.548 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:21:38.551 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-17T08:21:38.551 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:21:38.551 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:21:38.552 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:21:38.552 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:21:38.552 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:21:38.552 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:21:38.552 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-17T08:21:38.552 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-mon.a.asok log flush 2026-02-17T08:21:38.599 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:21:38.605 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-17T08:21:38.607 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:21:37.180+0000 7f8e7c43cec0 0 load: jerasure load: lrc 2026-02-17T08:21:38.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_ec_object_attr_read_error td/test-erasure-eio 2026-02-17T08:21:38.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:359: TEST_ec_object_attr_read_error: local dir=td/test-erasure-eio 2026-02-17T08:21:38.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:360: TEST_ec_object_attr_read_error: local objname=myobject 2026-02-17T08:21:38.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:362: TEST_ec_object_attr_read_error: setup_osds 7 2026-02-17T08:21:38.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=7 2026-02-17T08:21:38.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-17T08:21:38.608 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 7 - 1 2026-02-17T08:21:38.609 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 6 2026-02-17T08:21:38.613 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:21:38.613 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-17T08:21:38.613 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:21:38.613 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:21:38.613 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:21:38.613 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:21:38.614 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-17T08:21:38.614 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:21:38.614 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:21:38.614 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:21:38.614 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:21:38.614 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-17T08:21:38.614 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-17T08:21:38.614 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:21:38.614 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:21:38.614 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:21:38.614 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:21:38.615 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:21:38.615 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:21:38.615 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:21:38.615 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:21:38.615 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:21:38.615 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:21:38.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:21:38.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:21:38.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:21:38.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:21:38.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:21:38.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:21:38.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:21:38.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:21:38.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:21:38.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:21:38.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:21:38.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:21:38.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-17T08:21:38.616 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:21:38.617 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=142ec7ec-5773-44dd-b2ef-5136fba78c99 2026-02-17T08:21:38.617 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 142ec7ec-5773-44dd-b2ef-5136fba78c99' 2026-02-17T08:21:38.617 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 142ec7ec-5773-44dd-b2ef-5136fba78c99 2026-02-17T08:21:38.617 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:21:38.625 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQASJZRph5gSJRAAQhb5DTEa3JtL3sr9BOhQGg== 2026-02-17T08:21:38.625 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQASJZRph5gSJRAAQhb5DTEa3JtL3sr9BOhQGg=="}' 2026-02-17T08:21:38.626 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 142ec7ec-5773-44dd-b2ef-5136fba78c99 -i td/test-erasure-eio/0/new.json 2026-02-17T08:21:38.735 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:21:38.742 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-17T08:21:38.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQASJZRph5gSJRAAQhb5DTEa3JtL3sr9BOhQGg== --osd-uuid 142ec7ec-5773-44dd-b2ef-5136fba78c99 2026-02-17T08:21:38.758 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:38.752+0000 7f488102e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:21:38.760 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:38.752+0000 7f488102e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:21:38.761 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:38.756+0000 7f488102e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:21:38.761 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:38.756+0000 7f488102e8c0 -1 bdev(0x55eb1fd59c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:21:38.762 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:38.756+0000 7f488102e8c0 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-17T08:21:41.297 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-17T08:21:41.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:21:41.298 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:21:41.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:21:41.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:21:41.574 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:21:41.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:21:41.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:21:41.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:21:41.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:21:41.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:21:41.597 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:41.592+0000 7f1f0f3528c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:21:41.599 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:41.592+0000 7f1f0f3528c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:21:41.600 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:41.592+0000 7f1f0f3528c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:21:41.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:21:41.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:21:41.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:21:41.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:21:41.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:21:41.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:21:41.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:21:41.781 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:21:41.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:21:41.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:21:41.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:21:42.980 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:21:42.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:21:42.981 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:21:42.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:21:42.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:21:42.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:21:43.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:21:43.302 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:43.295+0000 7f1f0f3528c0 -1 Falling back to public interface 2026-02-17T08:21:44.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:21:44.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:21:44.180 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:21:44.181 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:21:44.181 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:21:44.181 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:21:44.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:21:45.382 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:21:45.382 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:21:45.382 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:21:45.383 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:21:45.383 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:21:45.383 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:21:45.578 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:21:46.321 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:46.311+0000 7f1f0f3528c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:21:46.579 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:21:46.580 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:21:46.580 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:21:46.580 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:21:46.581 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:21:46.581 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:21:46.771 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:21:47.772 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:21:47.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:21:47.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:21:47.773 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:21:47.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:21:47.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:21:47.978 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2335137886,v1:127.0.0.1:6803/2335137886] [v2:127.0.0.1:6804/2335137886,v1:127.0.0.1:6805/2335137886] exists,up 142ec7ec-5773-44dd-b2ef-5136fba78c99 2026-02-17T08:21:47.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:21:47.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:21:47.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:21:47.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:21:47.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-17T08:21:47.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:21:47.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:21:47.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T08:21:47.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:21:47.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-17T08:21:47.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:21:47.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:21:47.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:21:47.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:21:47.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-17T08:21:47.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-17T08:21:47.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:21:47.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:21:47.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:21:47.983 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:21:47.983 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:21:47.984 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:21:47.984 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:21:47.984 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:21:47.984 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:21:47.984 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:21:47.984 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:21:47.984 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:21:47.984 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:21:47.984 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:21:47.984 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:21:47.984 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:21:47.984 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:21:47.984 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:21:47.985 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:21:47.985 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:21:47.985 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:21:47.985 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:21:47.985 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-17T08:21:47.985 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:21:47.986 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=3fe9ebf7-61b1-4cbf-8907-24dfcf5c66c8 2026-02-17T08:21:47.986 INFO:tasks.workunit.client.0.trial059.stdout:add osd1 3fe9ebf7-61b1-4cbf-8907-24dfcf5c66c8 2026-02-17T08:21:47.986 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 3fe9ebf7-61b1-4cbf-8907-24dfcf5c66c8' 2026-02-17T08:21:47.987 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:21:47.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAbJZRpFIUdOxAAEf6K1V2kVlArQObwvi4eRA== 2026-02-17T08:21:47.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAbJZRpFIUdOxAAEf6K1V2kVlArQObwvi4eRA=="}' 2026-02-17T08:21:47.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 3fe9ebf7-61b1-4cbf-8907-24dfcf5c66c8 -i td/test-erasure-eio/1/new.json 2026-02-17T08:21:48.208 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:21:48.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-17T08:21:48.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAbJZRpFIUdOxAAEf6K1V2kVlArQObwvi4eRA== --osd-uuid 3fe9ebf7-61b1-4cbf-8907-24dfcf5c66c8 2026-02-17T08:21:48.234 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:48.227+0000 7f29094458c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:21:48.235 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:48.227+0000 7f29094458c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:21:48.236 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:48.227+0000 7f29094458c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:21:48.237 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:48.231+0000 7f29094458c0 -1 bdev(0x55c6c5d4bc00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-17T08:21:48.237 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:48.231+0000 7f29094458c0 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-17T08:21:50.506 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-17T08:21:50.506 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:21:50.507 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T08:21:50.507 INFO:tasks.workunit.client.0.trial059.stdout:adding osd1 key to auth repository 2026-02-17T08:21:50.508 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:21:50.776 INFO:tasks.workunit.client.0.trial059.stdout:start osd.1 2026-02-17T08:21:50.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T08:21:50.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:21:50.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:21:50.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:21:50.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:21:50.801 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:50.791+0000 7f175272c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:21:50.802 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:50.795+0000 7f175272c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:21:50.803 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:50.795+0000 7f175272c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:21:50.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T08:21:50.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:21:50.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:21:50.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:21:50.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:21:50.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:21:50.976 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:21:50.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:21:50.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:21:50.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:21:51.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:21:52.174 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:21:52.175 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:21:52.175 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:21:52.175 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:21:52.176 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:21:52.176 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:21:52.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:21:52.519 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:52.511+0000 7f175272c8c0 -1 Falling back to public interface 2026-02-17T08:21:53.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:21:53.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:21:53.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:21:53.378 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:21:53.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:21:53.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:21:53.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:21:54.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:21:54.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:21:54.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:21:54.586 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:21:54.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:21:54.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:21:54.784 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:21:55.530 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:55.523+0000 7f175272c8c0 -1 osd.1 0 log_to_monitors true 2026-02-17T08:21:55.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:21:55.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:21:55.786 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:21:55.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:21:55.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:21:55.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:21:55.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:21:56.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:21:56.984 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:21:56.984 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:21:56.985 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:21:56.985 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:21:56.985 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:21:57.182 INFO:tasks.workunit.client.0.trial059.stdout:osd.1 up in weight 1 up_from 12 up_thru 12 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2340949050,v1:127.0.0.1:6811/2340949050] [v2:127.0.0.1:6812/2340949050,v1:127.0.0.1:6813/2340949050] exists,up 3fe9ebf7-61b1-4cbf-8907-24dfcf5c66c8 2026-02-17T08:21:57.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:21:57.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:21:57.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:21:57.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:21:57.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-17T08:21:57.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:21:57.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:21:57.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T08:21:57.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:21:57.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-17T08:21:57.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:21:57.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:21:57.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:21:57.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:21:57.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-17T08:21:57.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-17T08:21:57.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:21:57.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:21:57.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:21:57.183 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:21:57.184 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:21:57.184 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:21:57.184 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:21:57.184 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:21:57.184 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:21:57.184 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:21:57.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:21:57.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:21:57.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:21:57.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:21:57.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:21:57.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:21:57.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:21:57.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:21:57.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:21:57.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:21:57.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:21:57.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:21:57.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-17T08:21:57.186 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:21:57.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=59b992c1-1335-4c92-969d-59cd8c3b32fb 2026-02-17T08:21:57.187 INFO:tasks.workunit.client.0.trial059.stdout:add osd2 59b992c1-1335-4c92-969d-59cd8c3b32fb 2026-02-17T08:21:57.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 59b992c1-1335-4c92-969d-59cd8c3b32fb' 2026-02-17T08:21:57.187 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:21:57.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAlJZRp8ZmuCxAA7dK5Kzt9RmFCxhKtSt6+/Q== 2026-02-17T08:21:57.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAlJZRp8ZmuCxAA7dK5Kzt9RmFCxhKtSt6+/Q=="}' 2026-02-17T08:21:57.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 59b992c1-1335-4c92-969d-59cd8c3b32fb -i td/test-erasure-eio/2/new.json 2026-02-17T08:21:57.406 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:21:57.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-17T08:21:57.416 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAlJZRp8ZmuCxAA7dK5Kzt9RmFCxhKtSt6+/Q== --osd-uuid 59b992c1-1335-4c92-969d-59cd8c3b32fb 2026-02-17T08:21:57.433 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:57.427+0000 7ff787b218c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:21:57.434 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:57.427+0000 7ff787b218c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:21:57.435 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:57.427+0000 7ff787b218c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:21:57.436 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:57.427+0000 7ff787b218c0 -1 bdev(0x556a9949bc00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-17T08:21:57.436 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:57.427+0000 7ff787b218c0 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-17T08:21:59.714 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-17T08:21:59.715 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:21:59.715 INFO:tasks.workunit.client.0.trial059.stdout:adding osd2 key to auth repository 2026-02-17T08:21:59.716 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T08:21:59.716 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:21:59.981 INFO:tasks.workunit.client.0.trial059.stdout:start osd.2 2026-02-17T08:21:59.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T08:21:59.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:21:59.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:21:59.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:21:59.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:21:59.997 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:59.991+0000 7ffaf5f878c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:21:59.998 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:59.991+0000 7ffaf5f878c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:21:59.999 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:21:59.991+0000 7ffaf5f878c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:00.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T08:22:00.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:22:00.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:22:00.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:22:00.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:22:00.179 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:22:00.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:00.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:22:00.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:00.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:22:00.375 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:01.376 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:01.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:01.377 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:22:01.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:22:01.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:01.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:22:01.490 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:01.483+0000 7ffaf5f878c0 -1 Falling back to public interface 2026-02-17T08:22:01.581 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:02.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:02.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:02.583 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:22:02.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:22:02.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:02.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:22:02.784 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:03.785 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:03.785 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:03.786 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:22:03.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:22:03.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:03.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:22:03.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:04.503 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:04.495+0000 7ffaf5f878c0 -1 osd.2 0 log_to_monitors true 2026-02-17T08:22:04.984 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:04.984 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:04.984 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:22:04.984 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:22:04.984 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:04.984 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:22:05.181 INFO:tasks.workunit.client.0.trial059.stdout:osd.2 up in weight 1 up_from 17 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1102822458,v1:127.0.0.1:6819/1102822458] [v2:127.0.0.1:6820/1102822458,v1:127.0.0.1:6821/1102822458] exists,up 59b992c1-1335-4c92-969d-59cd8c3b32fb 2026-02-17T08:22:05.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:22:05.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:22:05.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:22:05.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:22:05.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-17T08:22:05.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:22:05.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:22:05.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2026-02-17T08:22:05.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:22:05.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-17T08:22:05.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:22:05.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:22:05.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:22:05.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:22:05.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-17T08:22:05.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-17T08:22:05.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:22:05.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:22:05.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:22:05.186 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:22:05.186 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:22:05.186 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:22:05.187 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:22:05.187 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:22:05.187 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:22:05.187 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:22:05.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:22:05.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:22:05.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:22:05.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:22:05.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:22:05.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:22:05.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:22:05.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:22:05.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:22:05.188 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:22:05.188 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:22:05.188 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:22:05.188 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-17T08:22:05.188 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:22:05.188 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=0c6844bf-bd8e-4916-8469-60ba251261e8 2026-02-17T08:22:05.189 INFO:tasks.workunit.client.0.trial059.stdout:add osd3 0c6844bf-bd8e-4916-8469-60ba251261e8 2026-02-17T08:22:05.189 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 0c6844bf-bd8e-4916-8469-60ba251261e8' 2026-02-17T08:22:05.189 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:22:05.198 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAtJZRpFpGNCxAALcaJ58wEU1FBtX5WvqHOTw== 2026-02-17T08:22:05.198 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAtJZRpFpGNCxAALcaJ58wEU1FBtX5WvqHOTw=="}' 2026-02-17T08:22:05.198 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 0c6844bf-bd8e-4916-8469-60ba251261e8 -i td/test-erasure-eio/3/new.json 2026-02-17T08:22:05.397 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:22:05.407 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-17T08:22:05.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAtJZRpFpGNCxAALcaJ58wEU1FBtX5WvqHOTw== --osd-uuid 0c6844bf-bd8e-4916-8469-60ba251261e8 2026-02-17T08:22:05.423 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:05.415+0000 7f710b2288c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:05.425 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:05.415+0000 7f710b2288c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:05.426 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:05.419+0000 7f710b2288c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:05.426 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:05.419+0000 7f710b2288c0 -1 bdev(0x55f01b34fc00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-17T08:22:05.427 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:05.419+0000 7f710b2288c0 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-17T08:22:07.724 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-17T08:22:07.725 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:22:07.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2026-02-17T08:22:07.726 INFO:tasks.workunit.client.0.trial059.stdout:adding osd3 key to auth repository 2026-02-17T08:22:07.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:22:07.995 INFO:tasks.workunit.client.0.trial059.stdout:start osd.3 2026-02-17T08:22:07.996 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2026-02-17T08:22:07.996 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:22:07.996 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:22:07.996 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:22:07.996 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:22:08.018 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:08.011+0000 7ff22ec618c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:08.020 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:08.011+0000 7ff22ec618c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:08.021 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:08.011+0000 7ff22ec618c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:08.196 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2026-02-17T08:22:08.196 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:22:08.196 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T08:22:08.196 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:22:08.196 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:22:08.196 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:08.196 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:22:08.196 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:22:08.196 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:08.196 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:22:08.395 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:09.396 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:09.396 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:09.396 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:22:09.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:22:09.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:09.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:22:09.519 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:09.511+0000 7ff22ec618c0 -1 Falling back to public interface 2026-02-17T08:22:09.596 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:10.597 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:10.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:10.598 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:22:10.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:22:10.599 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:10.599 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:22:10.797 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:11.799 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:11.799 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:11.800 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:22:11.800 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:22:11.800 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:11.800 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:22:11.999 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:12.741 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:12.731+0000 7ff22ec618c0 -1 osd.3 0 log_to_monitors true 2026-02-17T08:22:13.001 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:13.001 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:13.001 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:22:13.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:22:13.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:13.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:22:13.209 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:14.211 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:14.211 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:14.211 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:22:14.211 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:22:14.211 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:14.211 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:22:14.408 INFO:tasks.workunit.client.0.trial059.stdout:osd.3 up in weight 1 up_from 25 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/646922153,v1:127.0.0.1:6827/646922153] [v2:127.0.0.1:6828/646922153,v1:127.0.0.1:6829/646922153] exists,up 0c6844bf-bd8e-4916-8469-60ba251261e8 2026-02-17T08:22:14.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:22:14.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:22:14.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:22:14.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:22:14.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 4 2026-02-17T08:22:14.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:22:14.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:22:14.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2026-02-17T08:22:14.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:22:14.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/4 2026-02-17T08:22:14.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:22:14.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:22:14.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:22:14.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:22:14.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/4' 2026-02-17T08:22:14.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/4/journal' 2026-02-17T08:22:14.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:22:14.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:22:14.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:22:14.410 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:22:14.410 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:22:14.410 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:22:14.410 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:22:14.411 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:22:14.411 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:22:14.411 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:22:14.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:22:14.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:22:14.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:22:14.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:22:14.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:22:14.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:22:14.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:22:14.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:22:14.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:22:14.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:22:14.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:22:14.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:22:14.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/4 2026-02-17T08:22:14.411 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:22:14.412 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=e78e8934-bcbc-414b-8658-8ef93d4837ca 2026-02-17T08:22:14.412 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 e78e8934-bcbc-414b-8658-8ef93d4837ca' 2026-02-17T08:22:14.412 INFO:tasks.workunit.client.0.trial059.stdout:add osd4 e78e8934-bcbc-414b-8658-8ef93d4837ca 2026-02-17T08:22:14.412 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:22:14.423 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQA2JZRpQBQEGRAA7PGzyn5rrVXtQ9C88CTwXA== 2026-02-17T08:22:14.424 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQA2JZRpQBQEGRAA7PGzyn5rrVXtQ9C88CTwXA=="}' 2026-02-17T08:22:14.424 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new e78e8934-bcbc-414b-8658-8ef93d4837ca -i td/test-erasure-eio/4/new.json 2026-02-17T08:22:14.619 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:22:14.628 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/4/new.json 2026-02-17T08:22:14.629 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA2JZRpQBQEGRAA7PGzyn5rrVXtQ9C88CTwXA== --osd-uuid e78e8934-bcbc-414b-8658-8ef93d4837ca 2026-02-17T08:22:14.645 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:14.634+0000 7f77ba0328c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:14.646 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:14.638+0000 7f77ba0328c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:14.648 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:14.638+0000 7f77ba0328c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:14.648 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:14.638+0000 7f77ba0328c0 -1 bdev(0x5640b16f3c00 td/test-erasure-eio/4/block) open stat got: (1) Operation not permitted 2026-02-17T08:22:14.648 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:14.638+0000 7f77ba0328c0 -1 bluestore(td/test-erasure-eio/4) _read_fsid unparsable uuid 2026-02-17T08:22:16.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/4/keyring 2026-02-17T08:22:16.943 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:22:16.943 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2026-02-17T08:22:16.944 INFO:tasks.workunit.client.0.trial059.stdout:adding osd4 key to auth repository 2026-02-17T08:22:16.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:22:17.211 INFO:tasks.workunit.client.0.trial059.stdout:start osd.4 2026-02-17T08:22:17.212 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2026-02-17T08:22:17.212 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:22:17.212 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:22:17.212 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:22:17.212 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:22:17.233 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:17.222+0000 7f1d1a7088c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:17.234 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:17.226+0000 7f1d1a7088c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:17.235 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:17.226+0000 7f1d1a7088c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:17.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2026-02-17T08:22:17.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:22:17.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2026-02-17T08:22:17.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:22:17.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:22:17.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:17.412 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:22:17.412 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:22:17.412 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:17.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:22:17.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:18.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:18.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:18.610 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:22:18.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:22:18.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:18.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:22:18.735 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:18.726+0000 7f1d1a7088c0 -1 Falling back to public interface 2026-02-17T08:22:18.808 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:19.810 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:19.810 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:19.810 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:22:19.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:22:19.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:19.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:22:20.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:21.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:21.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:21.008 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:22:21.009 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:22:21.009 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:21.009 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:22:21.201 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:22.037 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:22.026+0000 7f1d1a7088c0 -1 osd.4 0 log_to_monitors true 2026-02-17T08:22:22.202 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:22.202 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:22.203 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:22:22.203 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:22:22.203 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:22.203 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:22:22.405 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:23.407 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:23.407 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:23.408 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:22:23.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:22:23.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:23.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:22:23.604 INFO:tasks.workunit.client.0.trial059.stdout:osd.4 up in weight 1 up_from 33 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/3988742722,v1:127.0.0.1:6835/3988742722] [v2:127.0.0.1:6836/3988742722,v1:127.0.0.1:6837/3988742722] exists,up e78e8934-bcbc-414b-8658-8ef93d4837ca 2026-02-17T08:22:23.607 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:22:23.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:22:23.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:22:23.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:22:23.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 5 2026-02-17T08:22:23.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:22:23.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:22:23.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=5 2026-02-17T08:22:23.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:22:23.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/5 2026-02-17T08:22:23.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:22:23.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:22:23.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:22:23.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:22:23.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/5' 2026-02-17T08:22:23.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/5/journal' 2026-02-17T08:22:23.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:22:23.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:22:23.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:22:23.609 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:22:23.609 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:22:23.609 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:22:23.609 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:22:23.609 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:22:23.610 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:22:23.610 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:22:23.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:22:23.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:22:23.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:22:23.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:22:23.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:22:23.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:22:23.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:22:23.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:22:23.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:22:23.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:22:23.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:22:23.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:22:23.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/5 2026-02-17T08:22:23.611 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:22:23.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=cd5e0b36-db7b-4d8c-90ae-3739c43e5f04 2026-02-17T08:22:23.611 INFO:tasks.workunit.client.0.trial059.stdout:add osd5 cd5e0b36-db7b-4d8c-90ae-3739c43e5f04 2026-02-17T08:22:23.612 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd5 cd5e0b36-db7b-4d8c-90ae-3739c43e5f04' 2026-02-17T08:22:23.612 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:22:23.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQA/JZRpbuCyJBAAvgVuZncvuB7qahYkDn0SCQ== 2026-02-17T08:22:23.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQA/JZRpbuCyJBAAvgVuZncvuB7qahYkDn0SCQ=="}' 2026-02-17T08:22:23.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new cd5e0b36-db7b-4d8c-90ae-3739c43e5f04 -i td/test-erasure-eio/5/new.json 2026-02-17T08:22:23.822 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:22:23.831 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/5/new.json 2026-02-17T08:22:23.832 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 5 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA/JZRpbuCyJBAAvgVuZncvuB7qahYkDn0SCQ== --osd-uuid cd5e0b36-db7b-4d8c-90ae-3739c43e5f04 2026-02-17T08:22:23.847 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:23.838+0000 7fa3daab98c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:23.848 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:23.838+0000 7fa3daab98c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:23.849 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:23.838+0000 7fa3daab98c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:23.850 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:23.842+0000 7fa3daab98c0 -1 bdev(0x55f2f1fe9c00 td/test-erasure-eio/5/block) open stat got: (1) Operation not permitted 2026-02-17T08:22:23.850 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:23.842+0000 7fa3daab98c0 -1 bluestore(td/test-erasure-eio/5) _read_fsid unparsable uuid 2026-02-17T08:22:26.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/5/keyring 2026-02-17T08:22:26.144 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:22:26.145 INFO:tasks.workunit.client.0.trial059.stdout:adding osd5 key to auth repository 2026-02-17T08:22:26.145 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd5 key to auth repository 2026-02-17T08:22:26.145 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:22:26.416 INFO:tasks.workunit.client.0.trial059.stdout:start osd.5 2026-02-17T08:22:26.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.5 2026-02-17T08:22:26.418 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 5 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:22:26.418 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:22:26.418 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:22:26.418 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:22:26.432 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:26.422+0000 7f5caf44a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:26.433 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:26.422+0000 7f5caf44a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:26.434 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:26.426+0000 7f5caf44a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:26.617 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 5 2026-02-17T08:22:26.617 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:22:26.617 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=5 2026-02-17T08:22:26.618 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:22:26.618 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:22:26.618 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:22:26.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:26.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:22:26.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:26.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:22:26.814 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:27.816 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:27.816 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:27.816 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:22:27.817 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:22:27.817 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:27.817 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:22:27.975 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:27.966+0000 7f5caf44a8c0 -1 Falling back to public interface 2026-02-17T08:22:28.009 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:29.010 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:29.011 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:29.011 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:22:29.011 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:22:29.012 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:29.012 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:22:29.205 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:30.206 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:30.206 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:30.206 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:22:30.206 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:22:30.206 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:30.207 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:22:30.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:30.986 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:30.978+0000 7f5caf44a8c0 -1 osd.5 0 log_to_monitors true 2026-02-17T08:22:31.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:31.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:31.402 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:22:31.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:22:31.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:31.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:22:31.597 INFO:tasks.workunit.client.0.trial059.stdout:osd.5 up in weight 1 up_from 41 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/135177873,v1:127.0.0.1:6843/135177873] [v2:127.0.0.1:6844/135177873,v1:127.0.0.1:6845/135177873] exists,up cd5e0b36-db7b-4d8c-90ae-3739c43e5f04 2026-02-17T08:22:31.601 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:22:31.601 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:22:31.601 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:22:31.601 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:22:31.602 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 6 2026-02-17T08:22:31.602 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:22:31.602 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:22:31.602 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=6 2026-02-17T08:22:31.602 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:22:31.602 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/6 2026-02-17T08:22:31.603 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:22:31.603 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:22:31.603 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:22:31.603 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:22:31.603 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/6' 2026-02-17T08:22:31.603 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/6/journal' 2026-02-17T08:22:31.603 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:22:31.603 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:22:31.603 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:22:31.603 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:22:31.604 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:22:31.604 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:22:31.604 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:22:31.604 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:22:31.604 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:22:31.604 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:22:31.604 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:22:31.604 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:22:31.604 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:22:31.604 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:22:31.604 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:22:31.604 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:22:31.604 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:22:31.605 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:22:31.605 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:22:31.605 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:22:31.605 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:22:31.605 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:22:31.605 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/6 2026-02-17T08:22:31.606 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:22:31.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=7fa5bf4c-bf79-4e6b-96d7-224898f7e5dc 2026-02-17T08:22:31.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd6 7fa5bf4c-bf79-4e6b-96d7-224898f7e5dc' 2026-02-17T08:22:31.606 INFO:tasks.workunit.client.0.trial059.stdout:add osd6 7fa5bf4c-bf79-4e6b-96d7-224898f7e5dc 2026-02-17T08:22:31.607 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:22:31.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBHJZRp215wJBAAPPpydMyjbRd+jXMMCC2O6Q== 2026-02-17T08:22:31.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBHJZRp215wJBAAPPpydMyjbRd+jXMMCC2O6Q=="}' 2026-02-17T08:22:31.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 7fa5bf4c-bf79-4e6b-96d7-224898f7e5dc -i td/test-erasure-eio/6/new.json 2026-02-17T08:22:31.818 INFO:tasks.workunit.client.0.trial059.stdout:6 2026-02-17T08:22:31.827 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/6/new.json 2026-02-17T08:22:31.827 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 6 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBHJZRp215wJBAAPPpydMyjbRd+jXMMCC2O6Q== --osd-uuid 7fa5bf4c-bf79-4e6b-96d7-224898f7e5dc 2026-02-17T08:22:31.843 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:31.834+0000 7f01bcd7d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:31.844 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:31.834+0000 7f01bcd7d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:31.846 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:31.834+0000 7f01bcd7d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:31.846 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:31.838+0000 7f01bcd7d8c0 -1 bdev(0x559de7db1c00 td/test-erasure-eio/6/block) open stat got: (1) Operation not permitted 2026-02-17T08:22:31.846 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:31.838+0000 7f01bcd7d8c0 -1 bluestore(td/test-erasure-eio/6) _read_fsid unparsable uuid 2026-02-17T08:22:34.121 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/6/keyring 2026-02-17T08:22:34.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:22:34.122 INFO:tasks.workunit.client.0.trial059.stdout:adding osd6 key to auth repository 2026-02-17T08:22:34.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd6 key to auth repository 2026-02-17T08:22:34.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:22:34.389 INFO:tasks.workunit.client.0.trial059.stdout:start osd.6 2026-02-17T08:22:34.389 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.6 2026-02-17T08:22:34.389 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 6 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:22:34.389 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:22:34.390 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:22:34.390 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:22:34.412 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:34.402+0000 7f6aea2428c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:34.414 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:34.406+0000 7f6aea2428c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:34.415 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:34.406+0000 7f6aea2428c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:34.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 6 2026-02-17T08:22:34.591 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:22:34.591 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=6 2026-02-17T08:22:34.591 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:22:34.591 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:22:34.591 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:34.591 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:22:34.592 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:22:34.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:34.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:22:34.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:35.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:35.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:35.791 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:22:35.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:22:35.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:35.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:22:35.986 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:36.135 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:36.126+0000 7f6aea2428c0 -1 Falling back to public interface 2026-02-17T08:22:36.987 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:36.987 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:36.987 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:22:36.987 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:22:36.987 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:36.987 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:22:37.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:38.188 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:38.188 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:38.188 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:22:38.188 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:22:38.189 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:38.189 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:22:38.383 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:39.128 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:39.122+0000 7f6aea2428c0 -1 osd.6 0 log_to_monitors true 2026-02-17T08:22:39.384 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:39.385 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:39.385 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:22:39.385 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:22:39.385 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:39.385 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:22:39.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:40.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:40.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:40.588 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:22:40.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:22:40.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:40.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:22:40.787 INFO:tasks.workunit.client.0.trial059.stdout:osd.6 up in weight 1 up_from 49 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/1092389410,v1:127.0.0.1:6851/1092389410] [v2:127.0.0.1:6852/1092389410,v1:127.0.0.1:6853/1092389410] exists,up 7fa5bf4c-bf79-4e6b-96d7-224898f7e5dc 2026-02-17T08:22:40.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:22:40.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:22:40.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:22:40.787 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-17T08:22:40.787 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:22:40.788 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:22:40.788 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:22:40.788 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:22:40.788 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:22:40.788 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.0.asok 2026-02-17T08:22:40.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-17T08:22:40.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.0.asok log flush 2026-02-17T08:22:40.853 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:22:40.859 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-17T08:22:40.861 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:21:43.299+0000 7f1f0f3528c0 0 load: jerasure load: lrc 2026-02-17T08:22:40.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:364: TEST_ec_object_attr_read_error: local poolname=pool-jerasure 2026-02-17T08:22:40.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:365: TEST_ec_object_attr_read_error: create_erasure_coded_pool pool-jerasure 3 2 2026-02-17T08:22:40.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:22:40.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-17T08:22:40.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=3 2026-02-17T08:22:40.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-17T08:22:40.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=2 2026-02-17T08:22:40.862 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-17T08:22:40.862 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=3 m=2 crush-failure-domain=osd 2026-02-17T08:22:41.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-17T08:22:41.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-17T08:22:41.475 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' already exists 2026-02-17T08:22:41.484 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:22:42.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-17T08:22:42.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:22:42.487 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:22:42.487 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:22:42.487 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:22:42.487 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:22:42.488 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:22:42.488 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:22:42.488 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:22:42.488 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:22:42.594 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:22:42.594 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:22:42.594 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:22:42.594 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:22:42.594 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:22:42.594 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:22:42.800 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:22:42.800 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:22:42.800 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:22:42.800 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:22:42.800 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:22:42.801 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:22:42.801 INFO:tasks.workunit.client.0.trial059.stderr:6' 2026-02-17T08:22:42.801 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:22:42.801 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:22:42.801 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:22:42.875 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803791 2026-02-17T08:22:42.875 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803791 2026-02-17T08:22:42.875 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803791' 2026-02-17T08:22:42.875 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:22:42.875 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:22:42.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=51539607564 2026-02-17T08:22:42.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 51539607564 2026-02-17T08:22:42.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803791 1-51539607564' 2026-02-17T08:22:42.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:22:42.951 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:22:43.025 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=73014444042 2026-02-17T08:22:43.026 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 73014444042 2026-02-17T08:22:43.026 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803791 1-51539607564 2-73014444042' 2026-02-17T08:22:43.026 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:22:43.026 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:22:43.100 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=107374182408 2026-02-17T08:22:43.100 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 107374182408 2026-02-17T08:22:43.101 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803791 1-51539607564 2-73014444042 3-107374182408' 2026-02-17T08:22:43.101 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:22:43.101 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:22:43.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=141733920774 2026-02-17T08:22:43.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 141733920774 2026-02-17T08:22:43.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803791 1-51539607564 2-73014444042 3-107374182408 4-141733920774' 2026-02-17T08:22:43.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:22:43.179 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-17T08:22:43.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=176093659141 2026-02-17T08:22:43.253 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 176093659141 2026-02-17T08:22:43.253 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803791 1-51539607564 2-73014444042 3-107374182408 4-141733920774 5-176093659141' 2026-02-17T08:22:43.253 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:22:43.253 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-17T08:22:43.328 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=210453397507 2026-02-17T08:22:43.328 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 210453397507 2026-02-17T08:22:43.328 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803791 1-51539607564 2-73014444042 3-107374182408 4-141733920774 5-176093659141 6-210453397507' 2026-02-17T08:22:43.328 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:22:43.329 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803791 2026-02-17T08:22:43.329 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:22:43.330 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:22:43.331 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803791 2026-02-17T08:22:43.331 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:22:43.332 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803791 2026-02-17T08:22:43.332 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 25769803791 2026-02-17T08:22:43.333 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803791' 2026-02-17T08:22:43.333 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:22:43.538 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803788 -lt 25769803791 2026-02-17T08:22:43.538 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:22:44.540 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:22:44.540 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:22:44.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803791 -lt 25769803791 2026-02-17T08:22:44.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:22:44.736 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-51539607564 2026-02-17T08:22:44.736 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:22:44.737 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:22:44.738 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-51539607564 2026-02-17T08:22:44.738 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:22:44.739 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=51539607564 2026-02-17T08:22:44.739 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 51539607564' 2026-02-17T08:22:44.740 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 51539607564 2026-02-17T08:22:44.740 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:22:44.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 51539607564 -lt 51539607564 2026-02-17T08:22:44.941 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:22:44.941 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-73014444042 2026-02-17T08:22:44.941 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:22:44.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:22:44.943 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-73014444042 2026-02-17T08:22:44.943 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:22:44.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=73014444042 2026-02-17T08:22:44.945 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 73014444042 2026-02-17T08:22:44.945 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 73014444042' 2026-02-17T08:22:44.945 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:22:45.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 73014444042 -lt 73014444042 2026-02-17T08:22:45.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:22:45.143 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-107374182408 2026-02-17T08:22:45.143 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:22:45.145 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:22:45.145 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-107374182408 2026-02-17T08:22:45.145 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:22:45.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=107374182408 2026-02-17T08:22:45.147 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 107374182408 2026-02-17T08:22:45.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 107374182408' 2026-02-17T08:22:45.148 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:22:45.346 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 107374182408 -lt 107374182408 2026-02-17T08:22:45.346 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:22:45.347 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-141733920774 2026-02-17T08:22:45.347 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:22:45.348 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:22:45.349 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-141733920774 2026-02-17T08:22:45.349 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:22:45.350 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=141733920774 2026-02-17T08:22:45.350 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 141733920774' 2026-02-17T08:22:45.351 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.4 seq 141733920774 2026-02-17T08:22:45.351 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:22:45.544 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 141733920775 -lt 141733920774 2026-02-17T08:22:45.544 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:22:45.545 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 5-176093659141 2026-02-17T08:22:45.545 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:22:45.546 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=5 2026-02-17T08:22:45.547 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 5-176093659141 2026-02-17T08:22:45.547 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:22:45.548 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=176093659141 2026-02-17T08:22:45.548 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.5 seq 176093659141' 2026-02-17T08:22:45.549 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.5 seq 176093659141 2026-02-17T08:22:45.549 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T08:22:45.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 176093659141 -lt 176093659141 2026-02-17T08:22:45.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:22:45.756 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 6-210453397507 2026-02-17T08:22:45.756 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:22:45.757 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=6 2026-02-17T08:22:45.758 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 6-210453397507 2026-02-17T08:22:45.758 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:22:45.759 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=210453397507 2026-02-17T08:22:45.759 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.6 seq 210453397507 2026-02-17T08:22:45.760 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.6 seq 210453397507' 2026-02-17T08:22:45.760 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T08:22:45.960 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 210453397508 -lt 210453397507 2026-02-17T08:22:45.960 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:22:45.960 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:22:45.961 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:22:46.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:22:46.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:22:46.225 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:22:46.225 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:22:46.225 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:22:46.225 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:22:46.225 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:22:46.225 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:22:46.418 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:22:46.419 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:22:46.419 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:22:46.419 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:22:46.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:22:46.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:22:46.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:22:46.681 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:367: TEST_ec_object_attr_read_error: get_primary pool-jerasure myobject 2026-02-17T08:22:46.681 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: get_primary: local poolname=pool-jerasure 2026-02-17T08:22:46.681 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: get_primary: local objectname=myobject 2026-02-17T08:22:46.681 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: get_primary: ceph --format json osd map pool-jerasure myobject 2026-02-17T08:22:46.681 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: get_primary: jq .acting_primary 2026-02-17T08:22:46.880 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:367: TEST_ec_object_attr_read_error: local primary_osd=3 2026-02-17T08:22:46.880 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:369: TEST_ec_object_attr_read_error: kill_daemons td/test-erasure-eio TERM osd.3 2026-02-17T08:22:46.881 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:22:46.881 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:22:46.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:22:46.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:22:46.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:22:48.192 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:22:48.192 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:372: TEST_ec_object_attr_read_error: rados_put td/test-erasure-eio pool-jerasure myobject 2026-02-17T08:22:48.192 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-17T08:22:48.192 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-17T08:22:48.192 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=myobject 2026-02-17T08:22:48.193 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:22:48.193 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-17T08:22:48.193 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:22:48.193 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-17T08:22:48.193 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:22:48.193 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-17T08:22:48.193 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:22:48.193 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-17T08:22:48.193 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put myobject td/test-erasure-eio/ORIGINAL 2026-02-17T08:22:48.212 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:375: TEST_ec_object_attr_read_error: inject_eio ec mdata pool-jerasure myobject td/test-erasure-eio 1 2026-02-17T08:22:48.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2457: inject_eio: local pooltype=ec 2026-02-17T08:22:48.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2458: inject_eio: shift 2026-02-17T08:22:48.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2459: inject_eio: local which=mdata 2026-02-17T08:22:48.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2460: inject_eio: shift 2026-02-17T08:22:48.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2461: inject_eio: local poolname=pool-jerasure 2026-02-17T08:22:48.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2462: inject_eio: shift 2026-02-17T08:22:48.214 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2463: inject_eio: local objname=myobject 2026-02-17T08:22:48.214 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2464: inject_eio: shift 2026-02-17T08:22:48.214 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2465: inject_eio: local dir=td/test-erasure-eio 2026-02-17T08:22:48.214 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2466: inject_eio: shift 2026-02-17T08:22:48.214 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2467: inject_eio: local shard_id=1 2026-02-17T08:22:48.214 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2468: inject_eio: shift 2026-02-17T08:22:48.214 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: get_osds pool-jerasure myobject 2026-02-17T08:22:48.214 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:22:48.214 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=myobject 2026-02-17T08:22:48.215 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-17T08:22:48.215 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:22:48.408 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=2147483647 2026-02-17T08:22:48.408 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:22:48.408 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:22:48.409 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:22:48.409 INFO:tasks.workunit.client.0.trial059.stderr:6' 2026-02-17T08:22:48.409 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 2147483647 5 1 0 6 2026-02-17T08:22:48.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: initial_osds=('2147483647' '5' '1' '0' '6') 2026-02-17T08:22:48.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: local -a initial_osds 2026-02-17T08:22:48.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2471: inject_eio: local osd_id=5 2026-02-17T08:22:48.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2472: inject_eio: '[' ec '!=' ec ']' 2026-02-17T08:22:48.409 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: cat td/test-erasure-eio/5/type 2026-02-17T08:22:48.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: type=bluestore 2026-02-17T08:22:48.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2476: inject_eio: set_config osd 5 bluestore_debug_inject_read_err true 2026-02-17T08:22:48.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1161: set_config: local daemon=osd 2026-02-17T08:22:48.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1162: set_config: local id=5 2026-02-17T08:22:48.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1163: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T08:22:48.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1164: set_config: local value=true 2026-02-17T08:22:48.411 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: jq 'has("success")' 2026-02-17T08:22:48.411 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: get_asok_path osd.5 2026-02-17T08:22:48.412 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2026-02-17T08:22:48.412 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2026-02-17T08:22:48.412 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:22:48.412 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:22:48.412 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:22:48.412 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.5.asok 2026-02-17T08:22:48.413 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.70936/ceph-osd.5.asok config set bluestore_debug_inject_read_err true 2026-02-17T08:22:48.470 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: test true == true 2026-02-17T08:22:48.470 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2477: inject_eio: local loop=0 2026-02-17T08:22:48.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2479: inject_eio: grep -q Invalid 2026-02-17T08:22:48.471 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: get_asok_path osd.5 2026-02-17T08:22:48.471 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2026-02-17T08:22:48.471 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2026-02-17T08:22:48.472 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:22:48.472 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:22:48.472 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:22:48.473 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.5.asok 2026-02-17T08:22:48.473 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: CEPH_ARGS= 2026-02-17T08:22:48.473 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.5.asok injectmdataerr pool-jerasure myobject 1 2026-02-17T08:22:48.530 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:378: TEST_ec_object_attr_read_error: activate_osd td/test-erasure-eio 3 2026-02-17T08:22:48.530 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-eio 2026-02-17T08:22:48.530 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:22:48.530 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=3 2026-02-17T08:22:48.530 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:22:48.530 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-eio/3 2026-02-17T08:22:48.530 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:22:48.530 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:22:48.530 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:22:48.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:22:48.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-17T08:22:48.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-17T08:22:48.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:22:48.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:22:48.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:22:48.531 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:22:48.531 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:22:48.531 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:22:48.531 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:22:48.531 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:22:48.531 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:22:48.531 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:22:48.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:22:48.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:22:48.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:22:48.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:22:48.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:22:48.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:22:48.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:22:48.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:22:48.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:22:48.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:22:48.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-eio/3 2026-02-17T08:22:48.533 INFO:tasks.workunit.client.0.trial059.stdout:start osd.3 2026-02-17T08:22:48.533 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.3 2026-02-17T08:22:48.533 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:22:48.533 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-eio/3/whoami 2026-02-17T08:22:48.534 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 3 = 3 ']' 2026-02-17T08:22:48.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:22:48.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:22:48.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:22:48.557 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:48.549+0000 7ff9af3018c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:48.559 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:48.553+0000 7ff9af3018c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:48.560 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:48.553+0000 7ff9af3018c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:22:48.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 3 2026-02-17T08:22:48.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:22:48.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T08:22:48.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:22:48.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:22:48.731 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:48.731 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:22:48.731 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:22:48.731 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:48.732 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:22:48.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:49.927 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:49.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:49.928 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:22:49.929 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:22:49.930 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:49.930 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:22:50.060 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:50.053+0000 7ff9af3018c0 -1 Falling back to public interface 2026-02-17T08:22:50.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:51.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:51.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:51.140 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:22:51.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:22:51.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:51.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:22:51.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:52.326 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:52.326 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:52.327 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:22:52.327 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:22:52.327 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:52.327 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:22:52.523 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:22:53.055 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:22:53.049+0000 7ff9af3018c0 -1 osd.3 57 log_to_monitors true 2026-02-17T08:22:53.524 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:22:53.524 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:22:53.524 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:22:53.525 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:22:53.525 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:22:53.525 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:22:53.718 INFO:tasks.workunit.client.0.trial059.stdout:osd.3 up in weight 1 up_from 61 up_thru 61 down_at 58 last_clean_interval [25,57) [v2:127.0.0.1:6826/3247215307,v1:127.0.0.1:6827/3247215307] [v2:127.0.0.1:6828/3247215307,v1:127.0.0.1:6829/3247215307] exists,up 0c6844bf-bd8e-4916-8469-60ba251261e8 2026-02-17T08:22:53.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:22:53.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:22:53.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:22:53.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:381: TEST_ec_object_attr_read_error: wait_for_clean 2026-02-17T08:22:53.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:22:53.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:22:53.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:22:53.719 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:22:53.719 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:22:53.719 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:22:53.719 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:22:53.719 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:22:53.719 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:22:53.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:22:53.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:22:53.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:22:53.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:22:53.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:22:53.834 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:22:54.036 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:22:54.036 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:22:54.036 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:22:54.036 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:22:54.036 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:22:54.036 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:22:54.036 INFO:tasks.workunit.client.0.trial059.stderr:6' 2026-02-17T08:22:54.036 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:22:54.036 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:22:54.036 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:22:54.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803795 2026-02-17T08:22:54.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803795 2026-02-17T08:22:54.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803795' 2026-02-17T08:22:54.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:22:54.115 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:22:54.189 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=51539607568 2026-02-17T08:22:54.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 51539607568 2026-02-17T08:22:54.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803795 1-51539607568' 2026-02-17T08:22:54.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:22:54.190 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:22:54.264 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=73014444046 2026-02-17T08:22:54.264 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 73014444046 2026-02-17T08:22:54.264 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803795 1-51539607568 2-73014444046' 2026-02-17T08:22:54.264 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:22:54.264 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:22:54.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=261993005059 2026-02-17T08:22:54.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 261993005059 2026-02-17T08:22:54.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803795 1-51539607568 2-73014444046 3-261993005059' 2026-02-17T08:22:54.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:22:54.342 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:22:54.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=141733920779 2026-02-17T08:22:54.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 141733920779 2026-02-17T08:22:54.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803795 1-51539607568 2-73014444046 3-261993005059 4-141733920779' 2026-02-17T08:22:54.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:22:54.417 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-17T08:22:54.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=176093659145 2026-02-17T08:22:54.494 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 176093659145 2026-02-17T08:22:54.494 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803795 1-51539607568 2-73014444046 3-261993005059 4-141733920779 5-176093659145' 2026-02-17T08:22:54.494 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:22:54.494 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-17T08:22:54.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=210453397511 2026-02-17T08:22:54.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 210453397511 2026-02-17T08:22:54.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803795 1-51539607568 2-73014444046 3-261993005059 4-141733920779 5-176093659145 6-210453397511' 2026-02-17T08:22:54.569 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:22:54.569 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803795 2026-02-17T08:22:54.569 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:22:54.570 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:22:54.571 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803795 2026-02-17T08:22:54.571 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:22:54.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803795 2026-02-17T08:22:54.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803795' 2026-02-17T08:22:54.573 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 25769803795 2026-02-17T08:22:54.573 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:22:54.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803793 -lt 25769803795 2026-02-17T08:22:54.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:22:55.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:22:55.779 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:22:55.971 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803795 -lt 25769803795 2026-02-17T08:22:55.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:22:55.972 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-51539607568 2026-02-17T08:22:55.972 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:22:55.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:22:55.974 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-51539607568 2026-02-17T08:22:55.974 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:22:55.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=51539607568 2026-02-17T08:22:55.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 51539607568' 2026-02-17T08:22:55.976 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 51539607568 2026-02-17T08:22:55.976 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:22:56.174 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 51539607568 -lt 51539607568 2026-02-17T08:22:56.174 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:22:56.175 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-73014444046 2026-02-17T08:22:56.175 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:22:56.176 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:22:56.177 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-73014444046 2026-02-17T08:22:56.177 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:22:56.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=73014444046 2026-02-17T08:22:56.178 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 73014444046 2026-02-17T08:22:56.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 73014444046' 2026-02-17T08:22:56.179 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:22:56.376 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 73014444046 -lt 73014444046 2026-02-17T08:22:56.376 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:22:56.377 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-261993005059 2026-02-17T08:22:56.377 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:22:56.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:22:56.378 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-261993005059 2026-02-17T08:22:56.379 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:22:56.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=261993005059 2026-02-17T08:22:56.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 261993005059' 2026-02-17T08:22:56.380 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 261993005059 2026-02-17T08:22:56.380 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:22:56.577 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 261993005059 -lt 261993005059 2026-02-17T08:22:56.577 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:22:56.577 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-141733920779 2026-02-17T08:22:56.577 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:22:56.579 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:22:56.579 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-141733920779 2026-02-17T08:22:56.580 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:22:56.581 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=141733920779 2026-02-17T08:22:56.581 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 141733920779' 2026-02-17T08:22:56.581 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.4 seq 141733920779 2026-02-17T08:22:56.581 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:22:56.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 141733920779 -lt 141733920779 2026-02-17T08:22:56.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:22:56.787 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 5-176093659145 2026-02-17T08:22:56.788 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:22:56.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=5 2026-02-17T08:22:56.789 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 5-176093659145 2026-02-17T08:22:56.789 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:22:56.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=176093659145 2026-02-17T08:22:56.791 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.5 seq 176093659145 2026-02-17T08:22:56.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.5 seq 176093659145' 2026-02-17T08:22:56.791 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T08:22:56.990 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 176093659145 -lt 176093659145 2026-02-17T08:22:56.990 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:22:56.990 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 6-210453397511 2026-02-17T08:22:56.990 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:22:56.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=6 2026-02-17T08:22:56.992 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 6-210453397511 2026-02-17T08:22:56.992 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:22:56.993 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=210453397511 2026-02-17T08:22:56.993 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.6 seq 210453397511' 2026-02-17T08:22:56.994 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.6 seq 210453397511 2026-02-17T08:22:56.994 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T08:22:57.196 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 210453397512 -lt 210453397511 2026-02-17T08:22:57.196 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:22:57.197 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:22:57.197 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:22:57.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:22:57.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:22:57.453 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:22:57.453 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:22:57.453 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:22:57.453 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:22:57.453 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:22:57.453 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:22:57.642 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:22:57.643 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:22:57.643 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:22:57.643 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:22:57.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:22:57.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:22:57.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:22:57.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:383: TEST_ec_object_attr_read_error: rados_get td/test-erasure-eio pool-jerasure myobject 2026-02-17T08:22:57.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:22:57.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:22:57.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=myobject 2026-02-17T08:22:57.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-17T08:22:57.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-17T08:22:57.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get myobject td/test-erasure-eio/COPY 2026-02-17T08:22:57.924 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-17T08:22:57.925 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-17T08:22:57.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:385: TEST_ec_object_attr_read_error: delete_erasure_coded_pool pool-jerasure 2026-02-17T08:22:57.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:22:57.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-17T08:22:58.168 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' does not exist 2026-02-17T08:22:58.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-17T08:22:58.437 INFO:tasks.workunit.client.0.trial059.stderr:erasure-code-profile myprofile does not exist 2026-02-17T08:22:58.446 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-17T08:22:58.446 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:22:58.447 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:22:58.447 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:22:58.447 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:22:58.447 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:22:58.447 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:22:58.447 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:22:58.447 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:22:58.761 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:22:58.761 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:22:58.762 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:22:58.763 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:22:58.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:22:58.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:22:58.765 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:22:58.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:22:58.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:22:58.767 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:22:58.767 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:22:58.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:22:58.769 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:22:58.769 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:22:58.791 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:22:58.791 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:22:58.791 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:22:58.792 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:22:58.793 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:22:58.793 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:22:58.793 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-17T08:22:58.793 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-17T08:22:58.793 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-eio 2026-02-17T08:22:58.793 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-eio 2026-02-17T08:22:58.793 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:22:58.793 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:22:58.793 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:22:58.794 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:22:58.794 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:22:58.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:22:58.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:22:58.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:22:58.796 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:22:58.796 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:22:58.797 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:22:58.798 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:22:58.799 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:22:58.799 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:22:58.799 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:22:58.801 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:22:58.801 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:22:58.801 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:22:58.801 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:22:58.802 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:22:58.804 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:22:58.804 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:22:58.805 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:22:58.805 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:22:58.805 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:22:58.805 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:22:58.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:22:58.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:22:58.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-eio 2026-02-17T08:22:58.808 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:22:58.808 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:22:58.808 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:22:58.808 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.70936 2026-02-17T08:22:58.809 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:22:58.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:22:58.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:22:58.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-17T08:22:58.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-17T08:22:58.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-eio 2026-02-17T08:22:58.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:22:58.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:22:58.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:22:58.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-eio/a 2026-02-17T08:22:58.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-17T08:22:58.831 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:22:58.831 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:22:58.832 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:22:58.832 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:22:58.832 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:22:58.832 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:22:58.832 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:22:58.833 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T08:22:58.862 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:22:58.863 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:22:58.863 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:22:58.863 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:22:58.863 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:22:58.863 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:22:58.863 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:22:58.863 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:22:58.864 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:22:58.864 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:22:58.864 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:22:58.864 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:22:58.864 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:22:58.865 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:22:58.865 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get fsid 2026-02-17T08:22:58.920 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:22:58.920 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:22:58.920 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:22:58.920 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:22:58.921 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:22:58.922 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:22:58.922 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:22:58.922 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:22:58.922 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:22:58.922 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:22:58.922 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:22:58.922 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:22:58.922 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:22:58.923 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get mon_host 2026-02-17T08:22:58.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-17T08:22:58.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-eio 2026-02-17T08:22:58.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:22:58.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:22:58.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:22:58.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-eio/x 2026-02-17T08:22:58.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:22:59.084 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:22:59.084 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:22:59.084 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:22:59.084 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:22:59.084 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:22:59.084 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:22:59.084 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:22:59.085 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:22:59.085 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:22:59.103 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-17T08:22:59.104 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T08:22:59.221 INFO:tasks.workunit.client.0.trial059.stderr:pool 'rbd' already exists 2026-02-17T08:22:59.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:23:00.231 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-17T08:23:00.231 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:23:00.231 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:23:00.231 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:23:00.231 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:23:00.231 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:23:00.231 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:23:00.232 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-17T08:23:00.232 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-mon.a.asok log flush 2026-02-17T08:23:00.293 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:23:00.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-17T08:23:00.300 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:22:58.845+0000 7f16b8189ec0 0 load: jerasure load: lrc 2026-02-17T08:23:00.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_ec_recovery_multiple_errors td/test-erasure-eio 2026-02-17T08:23:00.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:418: TEST_ec_recovery_multiple_errors: local dir=td/test-erasure-eio 2026-02-17T08:23:00.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:419: TEST_ec_recovery_multiple_errors: local objname=myobject 2026-02-17T08:23:00.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:421: TEST_ec_recovery_multiple_errors: setup_osds 9 2026-02-17T08:23:00.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=9 2026-02-17T08:23:00.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-17T08:23:00.301 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 9 - 1 2026-02-17T08:23:00.302 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 8 2026-02-17T08:23:00.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:23:00.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-17T08:23:00.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:23:00.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:23:00.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:23:00.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:23:00.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-17T08:23:00.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:23:00.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:23:00.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:23:00.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:23:00.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-17T08:23:00.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-17T08:23:00.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:23:00.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:23:00.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:23:00.305 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:23:00.305 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:23:00.305 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:23:00.305 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:23:00.305 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:23:00.305 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:23:00.305 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:23:00.305 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:23:00.305 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:23:00.305 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:23:00.305 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:23:00.306 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:23:00.306 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:23:00.306 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:23:00.306 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:23:00.306 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:23:00.306 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:23:00.306 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:23:00.306 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:23:00.306 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-17T08:23:00.307 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:23:00.308 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=23982b03-852f-46e5-8497-cbe670c5f5f9 2026-02-17T08:23:00.308 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 23982b03-852f-46e5-8497-cbe670c5f5f9' 2026-02-17T08:23:00.309 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 23982b03-852f-46e5-8497-cbe670c5f5f9 2026-02-17T08:23:00.309 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:23:00.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBkJZRp+YvUEhAAZHt5lxIYQJLgBPM7SBYSYg== 2026-02-17T08:23:00.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBkJZRp+YvUEhAAZHt5lxIYQJLgBPM7SBYSYg=="}' 2026-02-17T08:23:00.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 23982b03-852f-46e5-8497-cbe670c5f5f9 -i td/test-erasure-eio/0/new.json 2026-02-17T08:23:00.444 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:23:00.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-17T08:23:00.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBkJZRp+YvUEhAAZHt5lxIYQJLgBPM7SBYSYg== --osd-uuid 23982b03-852f-46e5-8497-cbe670c5f5f9 2026-02-17T08:23:00.470 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:00.465+0000 7f98a6d598c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:00.472 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:00.465+0000 7f98a6d598c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:00.473 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:00.465+0000 7f98a6d598c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:00.473 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:00.465+0000 7f98a6d598c0 -1 bdev(0x55b2e6549c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:23:00.474 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:00.465+0000 7f98a6d598c0 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-17T08:23:02.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-17T08:23:02.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:23:02.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:23:02.754 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:23:02.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:23:03.028 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:23:03.029 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:23:03.029 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:23:03.029 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:23:03.030 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:23:03.030 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:23:03.051 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:03.045+0000 7f0424e8e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:03.053 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:03.045+0000 7f0424e8e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:03.054 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:03.045+0000 7f0424e8e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:03.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:23:03.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:23:03.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:23:03.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:23:03.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:23:03.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:03.225 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:23:03.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:23:03.226 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:03.226 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:23:03.423 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:04.424 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:04.424 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:04.425 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:23:04.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:23:04.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:04.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:23:04.588 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:04.581+0000 7f0424e8e8c0 -1 Falling back to public interface 2026-02-17T08:23:04.622 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:05.624 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:05.624 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:05.624 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:23:05.625 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:23:05.625 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:05.625 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:23:05.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:06.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:06.824 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:06.824 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:23:06.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:23:06.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:06.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:23:07.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:07.554 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:07.545+0000 7f0424e8e8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:23:08.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:08.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:08.023 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:23:08.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:23:08.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:08.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:23:08.220 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 6 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3698804126,v1:127.0.0.1:6803/3698804126] [v2:127.0.0.1:6804/3698804126,v1:127.0.0.1:6805/3698804126] exists,up 23982b03-852f-46e5-8497-cbe670c5f5f9 2026-02-17T08:23:08.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:23:08.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:23:08.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:23:08.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:23:08.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-17T08:23:08.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:23:08.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:23:08.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T08:23:08.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:23:08.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-17T08:23:08.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:23:08.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:23:08.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:23:08.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:23:08.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-17T08:23:08.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-17T08:23:08.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:23:08.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:23:08.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:23:08.226 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:23:08.226 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:23:08.226 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:23:08.226 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:23:08.226 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:23:08.226 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:23:08.226 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:23:08.226 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:23:08.226 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:23:08.226 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:23:08.226 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:23:08.226 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:23:08.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:23:08.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:23:08.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:23:08.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:23:08.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:23:08.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:23:08.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:23:08.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-17T08:23:08.227 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:23:08.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=d5767aed-b669-4257-8afb-f1c0beeaa0a7 2026-02-17T08:23:08.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 d5767aed-b669-4257-8afb-f1c0beeaa0a7' 2026-02-17T08:23:08.228 INFO:tasks.workunit.client.0.trial059.stdout:add osd1 d5767aed-b669-4257-8afb-f1c0beeaa0a7 2026-02-17T08:23:08.228 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:23:08.237 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBsJZRpWR3LDRAAiSw0JBlV0cQ4IS5oI+Y2jQ== 2026-02-17T08:23:08.237 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBsJZRpWR3LDRAAiSw0JBlV0cQ4IS5oI+Y2jQ=="}' 2026-02-17T08:23:08.237 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new d5767aed-b669-4257-8afb-f1c0beeaa0a7 -i td/test-erasure-eio/1/new.json 2026-02-17T08:23:08.444 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:23:08.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-17T08:23:08.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBsJZRpWR3LDRAAiSw0JBlV0cQ4IS5oI+Y2jQ== --osd-uuid d5767aed-b669-4257-8afb-f1c0beeaa0a7 2026-02-17T08:23:08.469 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:08.461+0000 7feba27c58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:08.470 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:08.461+0000 7feba27c58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:08.471 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:08.465+0000 7feba27c58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:08.472 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:08.465+0000 7feba27c58c0 -1 bdev(0x5638a12e1c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-17T08:23:08.472 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:08.465+0000 7feba27c58c0 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-17T08:23:10.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-17T08:23:10.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:23:10.749 INFO:tasks.workunit.client.0.trial059.stdout:adding osd1 key to auth repository 2026-02-17T08:23:10.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T08:23:10.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:23:11.022 INFO:tasks.workunit.client.0.trial059.stdout:start osd.1 2026-02-17T08:23:11.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T08:23:11.024 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:23:11.024 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:23:11.024 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:23:11.024 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:23:11.046 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:11.037+0000 7fc8396e08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:11.048 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:11.041+0000 7fc8396e08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:11.050 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:11.041+0000 7fc8396e08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:11.221 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T08:23:11.222 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:23:11.222 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:23:11.222 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:23:11.222 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:23:11.222 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:11.222 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:23:11.222 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:23:11.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:11.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:23:11.423 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:12.424 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:12.424 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:12.425 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:23:12.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:23:12.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:12.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:23:12.623 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:12.749 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:12.741+0000 7fc8396e08c0 -1 Falling back to public interface 2026-02-17T08:23:13.624 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:13.624 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:13.624 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:23:13.625 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:23:13.625 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:13.625 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:23:13.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:14.824 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:14.824 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:14.824 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:23:14.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:23:14.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:14.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:23:15.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:15.719 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:15.709+0000 7fc8396e08c0 -1 osd.1 0 log_to_monitors true 2026-02-17T08:23:16.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:16.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:16.023 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:23:16.024 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:23:16.024 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:16.024 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:23:16.221 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:17.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:17.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:17.223 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:23:17.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:23:17.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:17.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:23:17.422 INFO:tasks.workunit.client.0.trial059.stdout:osd.1 up in weight 1 up_from 12 up_thru 12 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4161445837,v1:127.0.0.1:6811/4161445837] [v2:127.0.0.1:6812/4161445837,v1:127.0.0.1:6813/4161445837] exists,up d5767aed-b669-4257-8afb-f1c0beeaa0a7 2026-02-17T08:23:17.429 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:23:17.429 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:23:17.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:23:17.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:23:17.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-17T08:23:17.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:23:17.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:23:17.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T08:23:17.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:23:17.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-17T08:23:17.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:23:17.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:23:17.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:23:17.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:23:17.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-17T08:23:17.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-17T08:23:17.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:23:17.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:23:17.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:23:17.432 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:23:17.432 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:23:17.432 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:23:17.433 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:23:17.433 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:23:17.433 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:23:17.433 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:23:17.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:23:17.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:23:17.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:23:17.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:23:17.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:23:17.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:23:17.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:23:17.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:23:17.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:23:17.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:23:17.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:23:17.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:23:17.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-17T08:23:17.435 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:23:17.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=bd5b3125-4cf4-457b-8f91-6a559147222b 2026-02-17T08:23:17.436 INFO:tasks.workunit.client.0.trial059.stdout:add osd2 bd5b3125-4cf4-457b-8f91-6a559147222b 2026-02-17T08:23:17.436 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 bd5b3125-4cf4-457b-8f91-6a559147222b' 2026-02-17T08:23:17.436 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:23:17.438 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQB1JZRpJpbFGRAAzUvnUh5idd7sqOdVRFVx1A== 2026-02-17T08:23:17.438 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQB1JZRpJpbFGRAAzUvnUh5idd7sqOdVRFVx1A=="}' 2026-02-17T08:23:17.439 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new bd5b3125-4cf4-457b-8f91-6a559147222b -i td/test-erasure-eio/2/new.json 2026-02-17T08:23:17.647 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:23:17.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-17T08:23:17.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB1JZRpJpbFGRAAzUvnUh5idd7sqOdVRFVx1A== --osd-uuid bd5b3125-4cf4-457b-8f91-6a559147222b 2026-02-17T08:23:17.680 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:17.672+0000 7fb1241938c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:17.682 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:17.672+0000 7fb1241938c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:17.683 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:17.676+0000 7fb1241938c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:17.684 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:17.676+0000 7fb1241938c0 -1 bdev(0x56488f499c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-17T08:23:17.684 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:17.676+0000 7fb1241938c0 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-17T08:23:19.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-17T08:23:19.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:23:19.974 INFO:tasks.workunit.client.0.trial059.stdout:adding osd2 key to auth repository 2026-02-17T08:23:19.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T08:23:19.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:23:20.247 INFO:tasks.workunit.client.0.trial059.stdout:start osd.2 2026-02-17T08:23:20.248 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T08:23:20.248 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:23:20.248 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:23:20.248 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:23:20.249 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:23:20.262 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:20.252+0000 7fbeed0c88c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:20.263 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:20.256+0000 7fbeed0c88c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:20.264 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:20.256+0000 7fbeed0c88c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:20.444 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T08:23:20.445 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:23:20.445 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:23:20.445 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:23:20.445 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:23:20.445 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:20.445 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:23:20.445 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:23:20.446 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:20.446 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:23:20.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:21.651 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:21.651 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:21.651 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:23:21.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:23:21.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:21.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:23:21.756 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:21.748+0000 7fbeed0c88c0 -1 Falling back to public interface 2026-02-17T08:23:21.850 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:22.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:22.852 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:22.852 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:23:22.852 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:23:22.853 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:22.853 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:23:23.053 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:24.054 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:24.054 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:24.055 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:23:24.055 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:23:24.055 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:24.056 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:23:24.251 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:24.964 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:24.956+0000 7fbeed0c88c0 -1 osd.2 0 log_to_monitors true 2026-02-17T08:23:25.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:25.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:25.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:23:25.252 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:23:25.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:25.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:23:25.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:26.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:26.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:26.454 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:23:26.455 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:23:26.455 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:26.455 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:23:26.653 INFO:tasks.workunit.client.0.trial059.stdout:osd.2 up in weight 1 up_from 17 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2046172711,v1:127.0.0.1:6819/2046172711] [v2:127.0.0.1:6820/2046172711,v1:127.0.0.1:6821/2046172711] exists,up bd5b3125-4cf4-457b-8f91-6a559147222b 2026-02-17T08:23:26.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:23:26.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:23:26.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:23:26.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:23:26.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-17T08:23:26.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:23:26.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:23:26.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2026-02-17T08:23:26.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:23:26.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-17T08:23:26.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:23:26.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:23:26.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:23:26.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:23:26.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-17T08:23:26.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-17T08:23:26.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:23:26.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:23:26.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:23:26.657 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:23:26.658 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:23:26.658 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:23:26.658 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:23:26.658 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:23:26.658 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:23:26.658 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:23:26.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:23:26.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:23:26.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:23:26.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:23:26.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:23:26.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:23:26.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:23:26.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:23:26.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:23:26.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:23:26.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:23:26.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:23:26.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-17T08:23:26.660 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:23:26.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=7500bdfa-a9c3-43e5-8983-7161e947e5a7 2026-02-17T08:23:26.660 INFO:tasks.workunit.client.0.trial059.stdout:add osd3 7500bdfa-a9c3-43e5-8983-7161e947e5a7 2026-02-17T08:23:26.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 7500bdfa-a9c3-43e5-8983-7161e947e5a7' 2026-02-17T08:23:26.661 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:23:26.669 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQB+JZRpMHiLJxAAZDs7aWfm0ASTNvYQ4IUPkw== 2026-02-17T08:23:26.670 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQB+JZRpMHiLJxAAZDs7aWfm0ASTNvYQ4IUPkw=="}' 2026-02-17T08:23:26.670 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 7500bdfa-a9c3-43e5-8983-7161e947e5a7 -i td/test-erasure-eio/3/new.json 2026-02-17T08:23:26.876 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:23:26.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-17T08:23:26.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB+JZRpMHiLJxAAZDs7aWfm0ASTNvYQ4IUPkw== --osd-uuid 7500bdfa-a9c3-43e5-8983-7161e947e5a7 2026-02-17T08:23:26.901 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:26.892+0000 7f7fb1fa88c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:26.903 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:26.892+0000 7f7fb1fa88c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:26.904 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:26.896+0000 7f7fb1fa88c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:26.905 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:26.896+0000 7f7fb1fa88c0 -1 bdev(0x561ec51ebc00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-17T08:23:26.905 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:26.896+0000 7f7fb1fa88c0 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-17T08:23:29.197 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-17T08:23:29.197 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:23:29.198 INFO:tasks.workunit.client.0.trial059.stdout:adding osd3 key to auth repository 2026-02-17T08:23:29.198 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2026-02-17T08:23:29.198 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:23:29.470 INFO:tasks.workunit.client.0.trial059.stdout:start osd.3 2026-02-17T08:23:29.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2026-02-17T08:23:29.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:23:29.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:23:29.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:23:29.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:23:29.494 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:29.484+0000 7f0a6bd728c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:29.495 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:29.488+0000 7f0a6bd728c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:29.497 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:29.488+0000 7f0a6bd728c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:29.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2026-02-17T08:23:29.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:23:29.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T08:23:29.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:23:29.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:23:29.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:29.668 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:23:29.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:23:29.669 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:29.669 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:23:29.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:30.866 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:30.866 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:30.867 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:23:30.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:23:30.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:30.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:23:31.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:31.193 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:31.184+0000 7f0a6bd728c0 -1 Falling back to public interface 2026-02-17T08:23:32.064 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:32.064 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:32.064 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:23:32.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:23:32.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:32.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:23:32.262 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:33.263 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:33.264 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:33.264 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:23:33.265 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:23:33.265 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:33.265 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:23:33.460 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:34.197 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:34.188+0000 7f0a6bd728c0 -1 osd.3 0 log_to_monitors true 2026-02-17T08:23:34.462 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:34.462 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:34.462 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:23:34.463 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:23:34.463 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:34.463 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:23:34.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:35.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:35.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:35.664 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:23:35.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:23:35.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:35.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:23:35.864 INFO:tasks.workunit.client.0.trial059.stdout:osd.3 up in weight 1 up_from 24 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2710805536,v1:127.0.0.1:6827/2710805536] [v2:127.0.0.1:6828/2710805536,v1:127.0.0.1:6829/2710805536] exists,up 7500bdfa-a9c3-43e5-8983-7161e947e5a7 2026-02-17T08:23:35.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:23:35.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:23:35.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:23:35.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:23:35.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 4 2026-02-17T08:23:35.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:23:35.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:23:35.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2026-02-17T08:23:35.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:23:35.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/4 2026-02-17T08:23:35.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:23:35.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:23:35.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:23:35.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:23:35.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/4' 2026-02-17T08:23:35.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/4/journal' 2026-02-17T08:23:35.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:23:35.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:23:35.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:23:35.865 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:23:35.865 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:23:35.865 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:23:35.866 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:23:35.866 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:23:35.866 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:23:35.866 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:23:35.866 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:23:35.866 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:23:35.866 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:23:35.866 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:23:35.866 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:23:35.866 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:23:35.866 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:23:35.866 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:23:35.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:23:35.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:23:35.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:23:35.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:23:35.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/4 2026-02-17T08:23:35.867 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:23:35.868 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=e4cdfe71-4df6-42cd-b505-0d0c4c853feb 2026-02-17T08:23:35.868 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 e4cdfe71-4df6-42cd-b505-0d0c4c853feb' 2026-02-17T08:23:35.868 INFO:tasks.workunit.client.0.trial059.stdout:add osd4 e4cdfe71-4df6-42cd-b505-0d0c4c853feb 2026-02-17T08:23:35.868 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:23:35.880 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCHJZRpZS0eNBAA7F/n9eXCMq7mQaPB1vCIEQ== 2026-02-17T08:23:35.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCHJZRpZS0eNBAA7F/n9eXCMq7mQaPB1vCIEQ=="}' 2026-02-17T08:23:35.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new e4cdfe71-4df6-42cd-b505-0d0c4c853feb -i td/test-erasure-eio/4/new.json 2026-02-17T08:23:36.084 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:23:36.093 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/4/new.json 2026-02-17T08:23:36.094 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCHJZRpZS0eNBAA7F/n9eXCMq7mQaPB1vCIEQ== --osd-uuid e4cdfe71-4df6-42cd-b505-0d0c4c853feb 2026-02-17T08:23:36.111 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:36.100+0000 7fbb6d34c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:36.113 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:36.104+0000 7fbb6d34c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:36.113 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:36.104+0000 7fbb6d34c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:36.114 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:36.104+0000 7fbb6d34c8c0 -1 bdev(0x561704647c00 td/test-erasure-eio/4/block) open stat got: (1) Operation not permitted 2026-02-17T08:23:36.114 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:36.104+0000 7fbb6d34c8c0 -1 bluestore(td/test-erasure-eio/4) _read_fsid unparsable uuid 2026-02-17T08:23:38.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/4/keyring 2026-02-17T08:23:38.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:23:38.402 INFO:tasks.workunit.client.0.trial059.stdout:adding osd4 key to auth repository 2026-02-17T08:23:38.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2026-02-17T08:23:38.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:23:38.674 INFO:tasks.workunit.client.0.trial059.stdout:start osd.4 2026-02-17T08:23:38.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2026-02-17T08:23:38.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:23:38.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:23:38.675 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:23:38.675 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:23:38.697 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:38.688+0000 7f9385cb08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:38.699 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:38.688+0000 7f9385cb08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:38.700 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:38.692+0000 7f9385cb08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:38.872 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2026-02-17T08:23:38.872 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:23:38.872 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2026-02-17T08:23:38.872 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:23:38.872 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:23:38.872 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:38.872 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:23:38.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:23:38.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:38.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:23:39.067 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:40.069 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:40.070 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:40.070 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:23:40.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:23:40.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:40.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:23:40.241 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:40.232+0000 7f9385cb08c0 -1 Falling back to public interface 2026-02-17T08:23:40.262 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:41.263 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:41.263 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:41.264 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:23:41.264 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:23:41.265 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:41.265 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:23:41.460 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:42.461 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:42.461 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:42.462 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:23:42.463 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:23:42.463 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:42.463 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:23:42.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:43.303 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:43.292+0000 7f9385cb08c0 -1 osd.4 0 log_to_monitors true 2026-02-17T08:23:43.654 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:43.654 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:43.655 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:23:43.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:23:43.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:43.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:23:43.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:44.862 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:44.862 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:44.862 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:23:44.862 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:23:44.862 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:44.862 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:23:45.055 INFO:tasks.workunit.client.0.trial059.stdout:osd.4 up in weight 1 up_from 33 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/1933525563,v1:127.0.0.1:6835/1933525563] [v2:127.0.0.1:6836/1933525563,v1:127.0.0.1:6837/1933525563] exists,up e4cdfe71-4df6-42cd-b505-0d0c4c853feb 2026-02-17T08:23:45.059 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:23:45.059 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:23:45.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:23:45.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:23:45.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 5 2026-02-17T08:23:45.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:23:45.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:23:45.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=5 2026-02-17T08:23:45.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:23:45.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/5 2026-02-17T08:23:45.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:23:45.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:23:45.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:23:45.061 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:23:45.061 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/5' 2026-02-17T08:23:45.061 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/5/journal' 2026-02-17T08:23:45.061 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:23:45.061 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:23:45.061 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:23:45.061 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:23:45.061 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:23:45.061 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:23:45.061 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:23:45.061 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:23:45.061 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:23:45.062 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:23:45.062 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:23:45.062 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:23:45.062 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:23:45.062 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:23:45.062 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:23:45.062 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:23:45.062 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:23:45.062 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:23:45.062 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:23:45.062 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:23:45.062 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:23:45.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:23:45.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/5 2026-02-17T08:23:45.063 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:23:45.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=e9c48333-d997-44c9-9a02-a1d6f38d2cf8 2026-02-17T08:23:45.063 INFO:tasks.workunit.client.0.trial059.stdout:add osd5 e9c48333-d997-44c9-9a02-a1d6f38d2cf8 2026-02-17T08:23:45.064 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd5 e9c48333-d997-44c9-9a02-a1d6f38d2cf8' 2026-02-17T08:23:45.064 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:23:45.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCRJZRpwbfcAxAAzt+bqJ9l2uMCpBoPTsMJxg== 2026-02-17T08:23:45.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCRJZRpwbfcAxAAzt+bqJ9l2uMCpBoPTsMJxg=="}' 2026-02-17T08:23:45.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new e9c48333-d997-44c9-9a02-a1d6f38d2cf8 -i td/test-erasure-eio/5/new.json 2026-02-17T08:23:45.273 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:23:45.282 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/5/new.json 2026-02-17T08:23:45.283 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 5 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCRJZRpwbfcAxAAzt+bqJ9l2uMCpBoPTsMJxg== --osd-uuid e9c48333-d997-44c9-9a02-a1d6f38d2cf8 2026-02-17T08:23:45.298 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:45.288+0000 7f62c935c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:45.299 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:45.288+0000 7f62c935c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:45.301 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:45.292+0000 7f62c935c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:45.301 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:45.292+0000 7f62c935c8c0 -1 bdev(0x55870c953c00 td/test-erasure-eio/5/block) open stat got: (1) Operation not permitted 2026-02-17T08:23:45.301 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:45.292+0000 7f62c935c8c0 -1 bluestore(td/test-erasure-eio/5) _read_fsid unparsable uuid 2026-02-17T08:23:47.580 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/5/keyring 2026-02-17T08:23:47.580 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:23:47.581 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd5 key to auth repository 2026-02-17T08:23:47.581 INFO:tasks.workunit.client.0.trial059.stdout:adding osd5 key to auth repository 2026-02-17T08:23:47.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:23:47.850 INFO:tasks.workunit.client.0.trial059.stdout:start osd.5 2026-02-17T08:23:47.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.5 2026-02-17T08:23:47.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 5 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:23:47.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:23:47.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:23:47.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:23:47.874 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:47.863+0000 7f75795f48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:47.876 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:47.867+0000 7f75795f48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:47.877 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:47.867+0000 7f75795f48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:48.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 5 2026-02-17T08:23:48.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:23:48.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=5 2026-02-17T08:23:48.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:23:48.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:23:48.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:48.051 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:23:48.052 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:23:48.052 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:48.052 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:23:48.245 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:49.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:49.247 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:49.247 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:23:49.248 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:23:49.248 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:49.248 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:23:49.369 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:49.359+0000 7f75795f48c0 -1 Falling back to public interface 2026-02-17T08:23:49.442 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:50.443 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:50.443 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:50.444 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:23:50.444 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:23:50.444 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:50.445 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:23:50.638 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:51.640 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:51.640 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:51.640 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:23:51.641 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:23:51.642 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:51.642 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:23:51.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:52.337 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:52.327+0000 7f75795f48c0 -1 osd.5 0 log_to_monitors true 2026-02-17T08:23:52.836 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:52.836 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:52.836 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:23:52.836 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:23:52.836 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:52.836 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:23:53.034 INFO:tasks.workunit.client.0.trial059.stdout:osd.5 up in weight 1 up_from 42 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/1626262348,v1:127.0.0.1:6843/1626262348] [v2:127.0.0.1:6844/1626262348,v1:127.0.0.1:6845/1626262348] exists,up e9c48333-d997-44c9-9a02-a1d6f38d2cf8 2026-02-17T08:23:53.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:23:53.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:23:53.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:23:53.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:23:53.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 6 2026-02-17T08:23:53.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:23:53.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:23:53.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=6 2026-02-17T08:23:53.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:23:53.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/6 2026-02-17T08:23:53.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:23:53.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:23:53.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:23:53.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:23:53.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/6' 2026-02-17T08:23:53.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/6/journal' 2026-02-17T08:23:53.040 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:23:53.040 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:23:53.040 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:23:53.040 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:23:53.040 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:23:53.040 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:23:53.040 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:23:53.040 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:23:53.040 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:23:53.040 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:23:53.040 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:23:53.041 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:23:53.041 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:23:53.041 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:23:53.041 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:23:53.041 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:23:53.041 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:23:53.041 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:23:53.041 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:23:53.041 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:23:53.041 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:23:53.041 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:23:53.041 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/6 2026-02-17T08:23:53.042 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:23:53.042 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=28f9ebc4-469f-42af-9e10-37d91eff55f7 2026-02-17T08:23:53.042 INFO:tasks.workunit.client.0.trial059.stdout:add osd6 28f9ebc4-469f-42af-9e10-37d91eff55f7 2026-02-17T08:23:53.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd6 28f9ebc4-469f-42af-9e10-37d91eff55f7' 2026-02-17T08:23:53.043 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:23:53.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCZJZRp6+ubAhAAB3xyijeMHuCBthnUC0TgoA== 2026-02-17T08:23:53.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCZJZRp6+ubAhAAB3xyijeMHuCBthnUC0TgoA=="}' 2026-02-17T08:23:53.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 28f9ebc4-469f-42af-9e10-37d91eff55f7 -i td/test-erasure-eio/6/new.json 2026-02-17T08:23:53.246 INFO:tasks.workunit.client.0.trial059.stdout:6 2026-02-17T08:23:53.255 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/6/new.json 2026-02-17T08:23:53.256 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 6 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCZJZRp6+ubAhAAB3xyijeMHuCBthnUC0TgoA== --osd-uuid 28f9ebc4-469f-42af-9e10-37d91eff55f7 2026-02-17T08:23:53.272 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:53.263+0000 7f5152a8e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:53.274 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:53.263+0000 7f5152a8e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:53.275 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:53.263+0000 7f5152a8e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:53.275 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:53.263+0000 7f5152a8e8c0 -1 bdev(0x55be8b059c00 td/test-erasure-eio/6/block) open stat got: (1) Operation not permitted 2026-02-17T08:23:53.276 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:53.263+0000 7f5152a8e8c0 -1 bluestore(td/test-erasure-eio/6) _read_fsid unparsable uuid 2026-02-17T08:23:55.574 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/6/keyring 2026-02-17T08:23:55.574 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:23:55.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd6 key to auth repository 2026-02-17T08:23:55.575 INFO:tasks.workunit.client.0.trial059.stdout:adding osd6 key to auth repository 2026-02-17T08:23:55.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:23:55.847 INFO:tasks.workunit.client.0.trial059.stdout:start osd.6 2026-02-17T08:23:55.847 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.6 2026-02-17T08:23:55.847 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 6 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:23:55.847 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:23:55.848 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:23:55.848 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:23:55.871 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:55.859+0000 7f24720588c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:55.872 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:55.863+0000 7f24720588c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:55.874 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:55.863+0000 7f24720588c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:23:56.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 6 2026-02-17T08:23:56.047 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:23:56.047 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=6 2026-02-17T08:23:56.047 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:23:56.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:23:56.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:23:56.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:56.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:23:56.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:56.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:23:56.241 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:57.243 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:57.243 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:57.243 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:23:57.244 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:23:57.244 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:57.245 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:23:57.386 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:23:57.375+0000 7f24720588c0 -1 Falling back to public interface 2026-02-17T08:23:57.441 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:58.442 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:58.442 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:58.442 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:23:58.443 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:23:58.443 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:58.443 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:23:58.637 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:23:59.638 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:23:59.639 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:23:59.639 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:23:59.639 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:23:59.639 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:23:59.639 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:23:59.836 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:24:00.418 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:00.407+0000 7f24720588c0 -1 osd.6 0 log_to_monitors true 2026-02-17T08:24:00.838 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:24:00.839 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:00.839 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:24:00.839 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:24:00.839 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:00.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:24:01.037 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:24:02.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:24:02.039 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:24:02.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:02.039 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:24:02.040 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:02.040 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:24:02.235 INFO:tasks.workunit.client.0.trial059.stdout:osd.6 up in weight 1 up_from 51 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/1221139152,v1:127.0.0.1:6851/1221139152] [v2:127.0.0.1:6852/1221139152,v1:127.0.0.1:6853/1221139152] exists,up 28f9ebc4-469f-42af-9e10-37d91eff55f7 2026-02-17T08:24:02.239 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:24:02.239 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:24:02.239 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:24:02.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:24:02.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 7 2026-02-17T08:24:02.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:24:02.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:24:02.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=7 2026-02-17T08:24:02.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:24:02.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/7 2026-02-17T08:24:02.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:24:02.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:24:02.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:24:02.241 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:24:02.241 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/7' 2026-02-17T08:24:02.241 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/7/journal' 2026-02-17T08:24:02.241 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:24:02.241 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:24:02.241 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:24:02.241 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:24:02.241 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:24:02.241 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:24:02.241 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:24:02.241 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:24:02.241 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:24:02.242 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:24:02.242 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:24:02.242 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:24:02.242 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:24:02.242 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:24:02.242 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:24:02.242 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:24:02.242 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:24:02.242 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:24:02.242 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:24:02.242 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:24:02.242 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:24:02.242 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:24:02.243 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/7 2026-02-17T08:24:02.243 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:24:02.243 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=7f8413f7-70c9-40d9-b582-3575c43eb81f 2026-02-17T08:24:02.243 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd7 7f8413f7-70c9-40d9-b582-3575c43eb81f' 2026-02-17T08:24:02.244 INFO:tasks.workunit.client.0.trial059.stdout:add osd7 7f8413f7-70c9-40d9-b582-3575c43eb81f 2026-02-17T08:24:02.244 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:24:02.251 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCiJZRp6SaQDhAA9V16Cnj7VGSPhPNfAqs0OA== 2026-02-17T08:24:02.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCiJZRp6SaQDhAA9V16Cnj7VGSPhPNfAqs0OA=="}' 2026-02-17T08:24:02.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 7f8413f7-70c9-40d9-b582-3575c43eb81f -i td/test-erasure-eio/7/new.json 2026-02-17T08:24:02.455 INFO:tasks.workunit.client.0.trial059.stdout:7 2026-02-17T08:24:02.464 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/7/new.json 2026-02-17T08:24:02.465 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 7 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/7 --osd-journal=td/test-erasure-eio/7/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCiJZRp6SaQDhAA9V16Cnj7VGSPhPNfAqs0OA== --osd-uuid 7f8413f7-70c9-40d9-b582-3575c43eb81f 2026-02-17T08:24:02.481 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:02.471+0000 7f4c7ccd58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:02.483 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:02.471+0000 7f4c7ccd58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:02.484 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:02.471+0000 7f4c7ccd58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:02.484 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:02.471+0000 7f4c7ccd58c0 -1 bdev(0x562512b4dc00 td/test-erasure-eio/7/block) open stat got: (1) Operation not permitted 2026-02-17T08:24:02.484 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:02.475+0000 7f4c7ccd58c0 -1 bluestore(td/test-erasure-eio/7) _read_fsid unparsable uuid 2026-02-17T08:24:04.785 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/7/keyring 2026-02-17T08:24:04.785 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:24:04.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd7 key to auth repository 2026-02-17T08:24:04.786 INFO:tasks.workunit.client.0.trial059.stdout:adding osd7 key to auth repository 2026-02-17T08:24:04.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/7/keyring auth add osd.7 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:24:05.050 INFO:tasks.workunit.client.0.trial059.stdout:start osd.7 2026-02-17T08:24:05.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.7 2026-02-17T08:24:05.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 7 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/7 --osd-journal=td/test-erasure-eio/7/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:24:05.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:24:05.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:24:05.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:24:05.074 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:05.063+0000 7fc9bbb348c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:05.076 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:05.063+0000 7fc9bbb348c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:05.077 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:05.067+0000 7fc9bbb348c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:05.253 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 7 2026-02-17T08:24:05.253 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:24:05.253 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=7 2026-02-17T08:24:05.253 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:24:05.253 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:24:05.253 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:05.253 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:24:05.253 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:24:05.253 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:05.253 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2026-02-17T08:24:05.455 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:24:06.457 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:24:06.457 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:06.458 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:24:06.458 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:24:06.459 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:06.459 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2026-02-17T08:24:06.651 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:24:06.810 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:06.799+0000 7fc9bbb348c0 -1 Falling back to public interface 2026-02-17T08:24:07.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:24:07.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:07.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:24:07.652 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:24:07.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:07.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2026-02-17T08:24:07.848 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:24:08.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:24:08.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:08.849 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:24:08.850 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:24:08.850 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:08.850 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2026-02-17T08:24:09.041 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:24:09.841 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:09.831+0000 7fc9bbb348c0 -1 osd.7 0 log_to_monitors true 2026-02-17T08:24:10.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:24:10.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:10.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:24:10.044 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:24:10.044 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:10.044 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2026-02-17T08:24:10.248 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:24:11.250 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:24:11.250 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:11.251 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:24:11.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:24:11.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:11.253 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.7 up' 2026-02-17T08:24:11.448 INFO:tasks.workunit.client.0.trial059.stdout:osd.7 up in weight 1 up_from 59 up_thru 60 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6858/17879810,v1:127.0.0.1:6859/17879810] [v2:127.0.0.1:6860/17879810,v1:127.0.0.1:6861/17879810] exists,up 7f8413f7-70c9-40d9-b582-3575c43eb81f 2026-02-17T08:24:11.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:24:11.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:24:11.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:24:11.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:24:11.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 8 2026-02-17T08:24:11.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:24:11.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:24:11.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=8 2026-02-17T08:24:11.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:24:11.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/8 2026-02-17T08:24:11.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:24:11.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:24:11.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:24:11.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:24:11.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/8' 2026-02-17T08:24:11.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/8/journal' 2026-02-17T08:24:11.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:24:11.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:24:11.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:24:11.452 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:24:11.453 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:24:11.453 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:24:11.453 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:24:11.453 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:24:11.453 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:24:11.453 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:24:11.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:24:11.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:24:11.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:24:11.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:24:11.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:24:11.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:24:11.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:24:11.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:24:11.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:24:11.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:24:11.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:24:11.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:24:11.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/8 2026-02-17T08:24:11.454 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:24:11.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=51eb5bc6-ac8f-4bd8-8e9c-eb0f709e5796 2026-02-17T08:24:11.455 INFO:tasks.workunit.client.0.trial059.stdout:add osd8 51eb5bc6-ac8f-4bd8-8e9c-eb0f709e5796 2026-02-17T08:24:11.455 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd8 51eb5bc6-ac8f-4bd8-8e9c-eb0f709e5796' 2026-02-17T08:24:11.455 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:24:11.466 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCrJZRpmhhYGxAAirk08klldZKs3p3iUNzgCw== 2026-02-17T08:24:11.466 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCrJZRpmhhYGxAAirk08klldZKs3p3iUNzgCw=="}' 2026-02-17T08:24:11.467 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 51eb5bc6-ac8f-4bd8-8e9c-eb0f709e5796 -i td/test-erasure-eio/8/new.json 2026-02-17T08:24:11.673 INFO:tasks.workunit.client.0.trial059.stdout:8 2026-02-17T08:24:11.682 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/8/new.json 2026-02-17T08:24:11.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 8 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/8 --osd-journal=td/test-erasure-eio/8/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCrJZRpmhhYGxAAirk08klldZKs3p3iUNzgCw== --osd-uuid 51eb5bc6-ac8f-4bd8-8e9c-eb0f709e5796 2026-02-17T08:24:11.699 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:11.687+0000 7f413a40f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:11.700 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:11.687+0000 7f413a40f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:11.701 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:11.691+0000 7f413a40f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:11.702 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:11.691+0000 7f413a40f8c0 -1 bdev(0x55da5deadc00 td/test-erasure-eio/8/block) open stat got: (1) Operation not permitted 2026-02-17T08:24:11.702 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:11.691+0000 7f413a40f8c0 -1 bluestore(td/test-erasure-eio/8) _read_fsid unparsable uuid 2026-02-17T08:24:13.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/8/keyring 2026-02-17T08:24:13.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:24:13.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd8 key to auth repository 2026-02-17T08:24:13.977 INFO:tasks.workunit.client.0.trial059.stdout:adding osd8 key to auth repository 2026-02-17T08:24:13.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/8/keyring auth add osd.8 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:24:14.251 INFO:tasks.workunit.client.0.trial059.stdout:start osd.8 2026-02-17T08:24:14.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.8 2026-02-17T08:24:14.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 8 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/8 --osd-journal=td/test-erasure-eio/8/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:24:14.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:24:14.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:24:14.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:24:14.275 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:14.263+0000 7fd4bb4938c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:14.276 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:14.267+0000 7fd4bb4938c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:14.277 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:14.267+0000 7fd4bb4938c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:14.441 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 8 2026-02-17T08:24:14.441 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:24:14.441 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=8 2026-02-17T08:24:14.441 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:24:14.441 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:24:14.441 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:14.441 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:24:14.441 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:24:14.441 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:14.441 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2026-02-17T08:24:14.644 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:24:15.645 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:24:15.645 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:15.646 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:24:15.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:24:15.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:15.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2026-02-17T08:24:15.754 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:15.743+0000 7fd4bb4938c0 -1 Falling back to public interface 2026-02-17T08:24:15.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:24:16.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:24:16.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:16.845 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:24:16.846 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:24:16.846 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:16.846 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2026-02-17T08:24:17.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:24:18.045 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:24:18.045 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:18.045 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:24:18.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:24:18.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:18.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2026-02-17T08:24:18.243 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:24:18.969 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:18.959+0000 7fd4bb4938c0 -1 osd.8 0 log_to_monitors true 2026-02-17T08:24:19.245 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:24:19.245 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:19.245 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:24:19.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:24:19.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:19.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2026-02-17T08:24:19.446 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:24:20.448 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:24:20.448 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:20.448 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:24:20.449 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:24:20.449 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:20.449 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.8 up' 2026-02-17T08:24:20.644 INFO:tasks.workunit.client.0.trial059.stdout:osd.8 up in weight 1 up_from 68 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6866/3401512549,v1:127.0.0.1:6867/3401512549] [v2:127.0.0.1:6868/3401512549,v1:127.0.0.1:6869/3401512549] exists,up 51eb5bc6-ac8f-4bd8-8e9c-eb0f709e5796 2026-02-17T08:24:20.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:24:20.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:24:20.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:24:20.646 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-17T08:24:20.646 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:24:20.646 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:24:20.647 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:24:20.647 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:24:20.647 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:24:20.647 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.0.asok 2026-02-17T08:24:20.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-17T08:24:20.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.0.asok log flush 2026-02-17T08:24:20.708 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:24:20.714 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-17T08:24:20.717 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:23:04.585+0000 7f0424e8e8c0 0 load: jerasure load: lrc 2026-02-17T08:24:20.717 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:423: TEST_ec_recovery_multiple_errors: local poolname=pool-jerasure 2026-02-17T08:24:20.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:424: TEST_ec_recovery_multiple_errors: create_erasure_coded_pool pool-jerasure 4 4 2026-02-17T08:24:20.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:24:20.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-17T08:24:20.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=4 2026-02-17T08:24:20.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-17T08:24:20.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=4 2026-02-17T08:24:20.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-17T08:24:20.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=4 m=4 crush-failure-domain=osd 2026-02-17T08:24:20.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-17T08:24:20.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-17T08:24:21.335 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' already exists 2026-02-17T08:24:21.344 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:24:22.345 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-17T08:24:22.345 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:24:22.345 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:24:22.345 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:24:22.346 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:24:22.346 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:24:22.346 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:24:22.347 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:24:22.347 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:24:22.347 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:24:22.455 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:24:22.455 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:24:22.455 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:24:22.456 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:24:22.456 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:24:22.456 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:24:22.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:24:22.651 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:24:22.651 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:24:22.651 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:24:22.651 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:24:22.651 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:24:22.651 INFO:tasks.workunit.client.0.trial059.stderr:6 2026-02-17T08:24:22.651 INFO:tasks.workunit.client.0.trial059.stderr:7 2026-02-17T08:24:22.651 INFO:tasks.workunit.client.0.trial059.stderr:8' 2026-02-17T08:24:22.651 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:24:22.651 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:24:22.651 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:24:22.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803793 2026-02-17T08:24:22.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803793 2026-02-17T08:24:22.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793' 2026-02-17T08:24:22.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:24:22.727 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:24:22.801 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=51539607568 2026-02-17T08:24:22.801 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 51539607568 2026-02-17T08:24:22.801 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607568' 2026-02-17T08:24:22.801 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:24:22.802 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:24:22.879 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=73014444046 2026-02-17T08:24:22.879 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 73014444046 2026-02-17T08:24:22.879 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607568 2-73014444046' 2026-02-17T08:24:22.879 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:24:22.879 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:24:22.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=103079215116 2026-02-17T08:24:22.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 103079215116 2026-02-17T08:24:22.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607568 2-73014444046 3-103079215116' 2026-02-17T08:24:22.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:24:22.954 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:24:23.030 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=141733920778 2026-02-17T08:24:23.031 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 141733920778 2026-02-17T08:24:23.031 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607568 2-73014444046 3-103079215116 4-141733920778' 2026-02-17T08:24:23.031 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:24:23.031 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-17T08:24:23.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=180388626440 2026-02-17T08:24:23.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 180388626440 2026-02-17T08:24:23.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607568 2-73014444046 3-103079215116 4-141733920778 5-180388626440' 2026-02-17T08:24:23.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:24:23.109 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-17T08:24:23.182 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=219043332103 2026-02-17T08:24:23.182 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 219043332103 2026-02-17T08:24:23.182 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607568 2-73014444046 3-103079215116 4-141733920778 5-180388626440 6-219043332103' 2026-02-17T08:24:23.182 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:24:23.182 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-17T08:24:23.258 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=253403070469 2026-02-17T08:24:23.258 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 253403070469 2026-02-17T08:24:23.258 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607568 2-73014444046 3-103079215116 4-141733920778 5-180388626440 6-219043332103 7-253403070469' 2026-02-17T08:24:23.258 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:24:23.259 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-17T08:24:23.333 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=292057776131 2026-02-17T08:24:23.333 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 292057776131 2026-02-17T08:24:23.333 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607568 2-73014444046 3-103079215116 4-141733920778 5-180388626440 6-219043332103 7-253403070469 8-292057776131' 2026-02-17T08:24:23.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:24:23.334 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803793 2026-02-17T08:24:23.334 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:24:23.336 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:24:23.336 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803793 2026-02-17T08:24:23.337 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:24:23.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803793 2026-02-17T08:24:23.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803793' 2026-02-17T08:24:23.338 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 25769803793 2026-02-17T08:24:23.339 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:24:23.545 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803793 -lt 25769803793 2026-02-17T08:24:23.545 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:24:23.546 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-51539607568 2026-02-17T08:24:23.546 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:24:23.547 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:24:23.548 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-51539607568 2026-02-17T08:24:23.548 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:24:23.549 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=51539607568 2026-02-17T08:24:23.549 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 51539607568' 2026-02-17T08:24:23.550 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 51539607568 2026-02-17T08:24:23.550 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:24:23.751 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 51539607568 -lt 51539607568 2026-02-17T08:24:23.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:24:23.752 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-73014444046 2026-02-17T08:24:23.752 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:24:23.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:24:23.754 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-73014444046 2026-02-17T08:24:23.754 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:24:23.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=73014444046 2026-02-17T08:24:23.756 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 73014444046 2026-02-17T08:24:23.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 73014444046' 2026-02-17T08:24:23.756 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:24:23.963 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 73014444046 -lt 73014444046 2026-02-17T08:24:23.964 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:24:23.964 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-103079215116 2026-02-17T08:24:23.964 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:24:23.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:24:23.966 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-103079215116 2026-02-17T08:24:23.966 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:24:23.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=103079215116 2026-02-17T08:24:23.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 103079215116' 2026-02-17T08:24:23.968 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 103079215116 2026-02-17T08:24:23.968 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:24:24.174 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 103079215116 -lt 103079215116 2026-02-17T08:24:24.174 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:24:24.175 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-141733920778 2026-02-17T08:24:24.175 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:24:24.176 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:24:24.176 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-141733920778 2026-02-17T08:24:24.177 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:24:24.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=141733920778 2026-02-17T08:24:24.178 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.4 seq 141733920778 2026-02-17T08:24:24.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 141733920778' 2026-02-17T08:24:24.179 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:24:24.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 141733920778 -lt 141733920778 2026-02-17T08:24:24.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:24:24.379 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 5-180388626440 2026-02-17T08:24:24.379 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:24:24.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=5 2026-02-17T08:24:24.381 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 5-180388626440 2026-02-17T08:24:24.381 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:24:24.383 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=180388626440 2026-02-17T08:24:24.383 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.5 seq 180388626440' 2026-02-17T08:24:24.383 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.5 seq 180388626440 2026-02-17T08:24:24.383 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T08:24:24.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 180388626440 -lt 180388626440 2026-02-17T08:24:24.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:24:24.586 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 6-219043332103 2026-02-17T08:24:24.586 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:24:24.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=6 2026-02-17T08:24:24.588 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 6-219043332103 2026-02-17T08:24:24.588 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:24:24.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=219043332103 2026-02-17T08:24:24.590 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.6 seq 219043332103 2026-02-17T08:24:24.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.6 seq 219043332103' 2026-02-17T08:24:24.590 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T08:24:24.802 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 219043332103 -lt 219043332103 2026-02-17T08:24:24.802 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:24:24.803 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 7-253403070469 2026-02-17T08:24:24.803 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:24:24.804 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=7 2026-02-17T08:24:24.804 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 7-253403070469 2026-02-17T08:24:24.805 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:24:24.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=253403070469 2026-02-17T08:24:24.806 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.7 seq 253403070469 2026-02-17T08:24:24.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.7 seq 253403070469' 2026-02-17T08:24:24.806 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T08:24:25.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 253403070469 -lt 253403070469 2026-02-17T08:24:25.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:24:25.009 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 8-292057776131 2026-02-17T08:24:25.009 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:24:25.010 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=8 2026-02-17T08:24:25.011 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 8-292057776131 2026-02-17T08:24:25.011 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:24:25.012 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=292057776131 2026-02-17T08:24:25.012 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.8 seq 292057776131 2026-02-17T08:24:25.013 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.8 seq 292057776131' 2026-02-17T08:24:25.013 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T08:24:25.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 292057776130 -lt 292057776131 2026-02-17T08:24:25.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:24:26.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:24:26.225 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T08:24:26.421 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 292057776132 -lt 292057776131 2026-02-17T08:24:26.422 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:24:26.422 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:24:26.422 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:24:26.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:24:26.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:24:26.674 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:24:26.674 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:24:26.674 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:24:26.674 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:24:26.674 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:24:26.675 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:24:26.863 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:24:26.864 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:24:26.864 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:24:26.864 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:24:27.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:24:27.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:24:27.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:24:27.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:426: TEST_ec_recovery_multiple_errors: rados_put td/test-erasure-eio pool-jerasure myobject 2026-02-17T08:24:27.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-17T08:24:27.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-17T08:24:27.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=myobject 2026-02-17T08:24:27.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:24:27.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-17T08:24:27.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:24:27.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-17T08:24:27.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:24:27.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-17T08:24:27.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:24:27.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-17T08:24:27.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put myobject td/test-erasure-eio/ORIGINAL 2026-02-17T08:24:27.139 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:427: TEST_ec_recovery_multiple_errors: inject_eio ec data pool-jerasure myobject td/test-erasure-eio 0 2026-02-17T08:24:27.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2457: inject_eio: local pooltype=ec 2026-02-17T08:24:27.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2458: inject_eio: shift 2026-02-17T08:24:27.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2459: inject_eio: local which=data 2026-02-17T08:24:27.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2460: inject_eio: shift 2026-02-17T08:24:27.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2461: inject_eio: local poolname=pool-jerasure 2026-02-17T08:24:27.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2462: inject_eio: shift 2026-02-17T08:24:27.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2463: inject_eio: local objname=myobject 2026-02-17T08:24:27.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2464: inject_eio: shift 2026-02-17T08:24:27.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2465: inject_eio: local dir=td/test-erasure-eio 2026-02-17T08:24:27.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2466: inject_eio: shift 2026-02-17T08:24:27.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2467: inject_eio: local shard_id=0 2026-02-17T08:24:27.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2468: inject_eio: shift 2026-02-17T08:24:27.141 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: get_osds pool-jerasure myobject 2026-02-17T08:24:27.141 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:24:27.141 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=myobject 2026-02-17T08:24:27.141 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-17T08:24:27.141 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:24:27.345 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:24:27.345 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:24:27.345 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:24:27.346 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:24:27.346 INFO:tasks.workunit.client.0.trial059.stderr:6 2026-02-17T08:24:27.346 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:24:27.346 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:24:27.346 INFO:tasks.workunit.client.0.trial059.stderr:7' 2026-02-17T08:24:27.346 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 5 1 0 6 2 4 7 2026-02-17T08:24:27.346 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: initial_osds=('3' '5' '1' '0' '6' '2' '4' '7') 2026-02-17T08:24:27.346 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: local -a initial_osds 2026-02-17T08:24:27.346 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2471: inject_eio: local osd_id=3 2026-02-17T08:24:27.346 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2472: inject_eio: '[' ec '!=' ec ']' 2026-02-17T08:24:27.346 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: cat td/test-erasure-eio/3/type 2026-02-17T08:24:27.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: type=bluestore 2026-02-17T08:24:27.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2476: inject_eio: set_config osd 3 bluestore_debug_inject_read_err true 2026-02-17T08:24:27.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1161: set_config: local daemon=osd 2026-02-17T08:24:27.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1162: set_config: local id=3 2026-02-17T08:24:27.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1163: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T08:24:27.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1164: set_config: local value=true 2026-02-17T08:24:27.348 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: jq 'has("success")' 2026-02-17T08:24:27.349 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: get_asok_path osd.3 2026-02-17T08:24:27.349 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2026-02-17T08:24:27.349 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2026-02-17T08:24:27.349 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:24:27.349 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:24:27.349 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:24:27.349 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.3.asok 2026-02-17T08:24:27.350 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.70936/ceph-osd.3.asok config set bluestore_debug_inject_read_err true 2026-02-17T08:24:27.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: test true == true 2026-02-17T08:24:27.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2477: inject_eio: local loop=0 2026-02-17T08:24:27.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2479: inject_eio: grep -q Invalid 2026-02-17T08:24:27.410 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: get_asok_path osd.3 2026-02-17T08:24:27.410 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2026-02-17T08:24:27.410 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2026-02-17T08:24:27.410 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:24:27.410 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:24:27.410 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:24:27.411 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.3.asok 2026-02-17T08:24:27.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: CEPH_ARGS= 2026-02-17T08:24:27.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.3.asok injectdataerr pool-jerasure myobject 0 2026-02-17T08:24:27.468 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:430: TEST_ec_recovery_multiple_errors: inject_eio ec data pool-jerasure myobject td/test-erasure-eio 3 2026-02-17T08:24:27.468 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2457: inject_eio: local pooltype=ec 2026-02-17T08:24:27.468 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2458: inject_eio: shift 2026-02-17T08:24:27.468 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2459: inject_eio: local which=data 2026-02-17T08:24:27.468 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2460: inject_eio: shift 2026-02-17T08:24:27.468 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2461: inject_eio: local poolname=pool-jerasure 2026-02-17T08:24:27.468 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2462: inject_eio: shift 2026-02-17T08:24:27.468 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2463: inject_eio: local objname=myobject 2026-02-17T08:24:27.468 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2464: inject_eio: shift 2026-02-17T08:24:27.468 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2465: inject_eio: local dir=td/test-erasure-eio 2026-02-17T08:24:27.468 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2466: inject_eio: shift 2026-02-17T08:24:27.468 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2467: inject_eio: local shard_id=3 2026-02-17T08:24:27.468 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2468: inject_eio: shift 2026-02-17T08:24:27.468 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: get_osds pool-jerasure myobject 2026-02-17T08:24:27.468 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:24:27.468 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=myobject 2026-02-17T08:24:27.469 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-17T08:24:27.469 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:24:27.667 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:24:27.667 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:24:27.667 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:24:27.667 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:24:27.667 INFO:tasks.workunit.client.0.trial059.stderr:6 2026-02-17T08:24:27.667 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:24:27.667 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:24:27.667 INFO:tasks.workunit.client.0.trial059.stderr:7' 2026-02-17T08:24:27.667 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 5 1 0 6 2 4 7 2026-02-17T08:24:27.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: initial_osds=('3' '5' '1' '0' '6' '2' '4' '7') 2026-02-17T08:24:27.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: local -a initial_osds 2026-02-17T08:24:27.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2471: inject_eio: local osd_id=0 2026-02-17T08:24:27.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2472: inject_eio: '[' ec '!=' ec ']' 2026-02-17T08:24:27.668 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: cat td/test-erasure-eio/0/type 2026-02-17T08:24:27.669 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: type=bluestore 2026-02-17T08:24:27.670 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2476: inject_eio: set_config osd 0 bluestore_debug_inject_read_err true 2026-02-17T08:24:27.670 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1161: set_config: local daemon=osd 2026-02-17T08:24:27.670 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1162: set_config: local id=0 2026-02-17T08:24:27.670 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1163: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T08:24:27.670 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1164: set_config: local value=true 2026-02-17T08:24:27.670 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: jq 'has("success")' 2026-02-17T08:24:27.671 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: get_asok_path osd.0 2026-02-17T08:24:27.672 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:24:27.672 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:24:27.672 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:24:27.672 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:24:27.672 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:24:27.672 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.0.asok 2026-02-17T08:24:27.672 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.70936/ceph-osd.0.asok config set bluestore_debug_inject_read_err true 2026-02-17T08:24:27.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: test true == true 2026-02-17T08:24:27.731 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2477: inject_eio: local loop=0 2026-02-17T08:24:27.733 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2479: inject_eio: grep -q Invalid 2026-02-17T08:24:27.733 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: get_asok_path osd.0 2026-02-17T08:24:27.734 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:24:27.734 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:24:27.734 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:24:27.734 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:24:27.734 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:24:27.734 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.0.asok 2026-02-17T08:24:27.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: CEPH_ARGS= 2026-02-17T08:24:27.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.0.asok injectdataerr pool-jerasure myobject 3 2026-02-17T08:24:27.790 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:431: TEST_ec_recovery_multiple_errors: inject_eio ec data pool-jerasure myobject td/test-erasure-eio 4 2026-02-17T08:24:27.790 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2457: inject_eio: local pooltype=ec 2026-02-17T08:24:27.790 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2458: inject_eio: shift 2026-02-17T08:24:27.790 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2459: inject_eio: local which=data 2026-02-17T08:24:27.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2460: inject_eio: shift 2026-02-17T08:24:27.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2461: inject_eio: local poolname=pool-jerasure 2026-02-17T08:24:27.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2462: inject_eio: shift 2026-02-17T08:24:27.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2463: inject_eio: local objname=myobject 2026-02-17T08:24:27.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2464: inject_eio: shift 2026-02-17T08:24:27.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2465: inject_eio: local dir=td/test-erasure-eio 2026-02-17T08:24:27.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2466: inject_eio: shift 2026-02-17T08:24:27.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2467: inject_eio: local shard_id=4 2026-02-17T08:24:27.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2468: inject_eio: shift 2026-02-17T08:24:27.791 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: get_osds pool-jerasure myobject 2026-02-17T08:24:27.791 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:24:27.791 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=myobject 2026-02-17T08:24:27.792 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-17T08:24:27.792 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:24:27.992 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:24:27.992 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:24:27.992 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:24:27.993 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:24:27.993 INFO:tasks.workunit.client.0.trial059.stderr:6 2026-02-17T08:24:27.993 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:24:27.993 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:24:27.993 INFO:tasks.workunit.client.0.trial059.stderr:7' 2026-02-17T08:24:27.994 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 5 1 0 6 2 4 7 2026-02-17T08:24:27.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: initial_osds=('3' '5' '1' '0' '6' '2' '4' '7') 2026-02-17T08:24:27.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: local -a initial_osds 2026-02-17T08:24:27.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2471: inject_eio: local osd_id=6 2026-02-17T08:24:27.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2472: inject_eio: '[' ec '!=' ec ']' 2026-02-17T08:24:27.994 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: cat td/test-erasure-eio/6/type 2026-02-17T08:24:27.997 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: type=bluestore 2026-02-17T08:24:27.997 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2476: inject_eio: set_config osd 6 bluestore_debug_inject_read_err true 2026-02-17T08:24:27.997 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1161: set_config: local daemon=osd 2026-02-17T08:24:27.997 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1162: set_config: local id=6 2026-02-17T08:24:27.997 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1163: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T08:24:27.997 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1164: set_config: local value=true 2026-02-17T08:24:27.997 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: jq 'has("success")' 2026-02-17T08:24:27.997 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: get_asok_path osd.6 2026-02-17T08:24:27.998 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.6 2026-02-17T08:24:27.998 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.6 ']' 2026-02-17T08:24:27.998 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:24:27.998 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:24:27.998 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:24:27.998 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.6.asok 2026-02-17T08:24:27.998 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.70936/ceph-osd.6.asok config set bluestore_debug_inject_read_err true 2026-02-17T08:24:28.053 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: test true == true 2026-02-17T08:24:28.053 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2477: inject_eio: local loop=0 2026-02-17T08:24:28.055 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2479: inject_eio: grep -q Invalid 2026-02-17T08:24:28.055 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: get_asok_path osd.6 2026-02-17T08:24:28.055 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.6 2026-02-17T08:24:28.055 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.6 ']' 2026-02-17T08:24:28.055 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:24:28.055 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:24:28.055 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:24:28.055 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.6.asok 2026-02-17T08:24:28.056 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: CEPH_ARGS= 2026-02-17T08:24:28.056 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.6.asok injectdataerr pool-jerasure myobject 4 2026-02-17T08:24:28.111 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:433: TEST_ec_recovery_multiple_errors: get_osds pool-jerasure myobject 2026-02-17T08:24:28.112 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:24:28.112 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=myobject 2026-02-17T08:24:28.112 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-17T08:24:28.112 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:24:28.318 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:24:28.319 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:24:28.319 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:24:28.319 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:24:28.319 INFO:tasks.workunit.client.0.trial059.stderr:6 2026-02-17T08:24:28.319 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:24:28.319 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:24:28.319 INFO:tasks.workunit.client.0.trial059.stderr:7' 2026-02-17T08:24:28.319 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 5 1 0 6 2 4 7 2026-02-17T08:24:28.319 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:433: TEST_ec_recovery_multiple_errors: initial_osds=('3' '5' '1' '0' '6' '2' '4' '7') 2026-02-17T08:24:28.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:433: TEST_ec_recovery_multiple_errors: local -a initial_osds 2026-02-17T08:24:28.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:434: TEST_ec_recovery_multiple_errors: local last_osd=7 2026-02-17T08:24:28.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:436: TEST_ec_recovery_multiple_errors: kill_daemons td/test-erasure-eio TERM osd.7 2026-02-17T08:24:28.320 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:24:28.321 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:24:28.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:24:28.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:24:28.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:24:29.630 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:24:29.630 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:437: TEST_ec_recovery_multiple_errors: ceph osd down 7 2026-02-17T08:24:29.823 INFO:tasks.workunit.client.0.trial059.stderr:osd.7 is already down. 2026-02-17T08:24:29.832 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:438: TEST_ec_recovery_multiple_errors: ceph osd out 7 2026-02-17T08:24:30.083 INFO:tasks.workunit.client.0.trial059.stderr:osd.7 is already out. 2026-02-17T08:24:30.094 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:441: TEST_ec_recovery_multiple_errors: wait_for_clean 2026-02-17T08:24:30.094 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:24:30.094 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:24:30.094 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:24:30.094 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:24:30.095 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:24:30.095 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:24:30.096 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:24:30.096 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:24:30.096 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:24:30.201 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:24:30.201 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:24:30.201 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:24:30.201 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:24:30.202 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:24:30.202 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:24:30.399 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:24:30.399 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:24:30.399 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:24:30.399 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:24:30.399 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:24:30.399 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:24:30.400 INFO:tasks.workunit.client.0.trial059.stderr:6 2026-02-17T08:24:30.400 INFO:tasks.workunit.client.0.trial059.stderr:7 2026-02-17T08:24:30.400 INFO:tasks.workunit.client.0.trial059.stderr:8' 2026-02-17T08:24:30.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:24:30.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:24:30.400 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:24:30.475 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803797 2026-02-17T08:24:30.475 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803797 2026-02-17T08:24:30.475 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803797' 2026-02-17T08:24:30.475 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:24:30.475 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:24:30.550 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=51539607571 2026-02-17T08:24:30.550 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 51539607571 2026-02-17T08:24:30.550 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803797 1-51539607571' 2026-02-17T08:24:30.550 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:24:30.550 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:24:30.627 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=73014444049 2026-02-17T08:24:30.627 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 73014444049 2026-02-17T08:24:30.627 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803797 1-51539607571 2-73014444049' 2026-02-17T08:24:30.627 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:24:30.628 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:24:30.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=103079215120 2026-02-17T08:24:30.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 103079215120 2026-02-17T08:24:30.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803797 1-51539607571 2-73014444049 3-103079215120' 2026-02-17T08:24:30.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:24:30.704 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:24:30.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=141733920782 2026-02-17T08:24:30.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 141733920782 2026-02-17T08:24:30.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803797 1-51539607571 2-73014444049 3-103079215120 4-141733920782' 2026-02-17T08:24:30.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:24:30.778 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-17T08:24:30.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=180388626444 2026-02-17T08:24:30.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 180388626444 2026-02-17T08:24:30.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803797 1-51539607571 2-73014444049 3-103079215120 4-141733920782 5-180388626444' 2026-02-17T08:24:30.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:24:30.855 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-17T08:24:30.930 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=219043332106 2026-02-17T08:24:30.930 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 219043332106 2026-02-17T08:24:30.930 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803797 1-51539607571 2-73014444049 3-103079215120 4-141733920782 5-180388626444 6-219043332106' 2026-02-17T08:24:30.931 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:24:30.931 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2026-02-17T08:24:30.987 INFO:tasks.workunit.client.0.trial059.stderr:Error ENXIO: problem getting command descriptions from osd.7 2026-02-17T08:24:30.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq= 2026-02-17T08:24:30.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z '' 2026-02-17T08:24:30.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: continue 2026-02-17T08:24:30.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:24:30.991 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2026-02-17T08:24:31.062 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=292057776135 2026-02-17T08:24:31.062 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 292057776135 2026-02-17T08:24:31.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803797 1-51539607571 2-73014444049 3-103079215120 4-141733920782 5-180388626444 6-219043332106 8-292057776135' 2026-02-17T08:24:31.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:24:31.063 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803797 2026-02-17T08:24:31.063 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:24:31.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:24:31.065 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803797 2026-02-17T08:24:31.065 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:24:31.067 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803797 2026-02-17T08:24:31.067 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 25769803797 2026-02-17T08:24:31.067 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803797' 2026-02-17T08:24:31.067 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:24:31.269 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803795 -lt 25769803797 2026-02-17T08:24:31.269 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:24:32.270 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:24:32.271 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:24:32.473 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803797 -lt 25769803797 2026-02-17T08:24:32.473 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:24:32.473 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-51539607571 2026-02-17T08:24:32.473 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:24:32.475 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:24:32.475 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-51539607571 2026-02-17T08:24:32.475 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:24:32.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=51539607571 2026-02-17T08:24:32.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 51539607571' 2026-02-17T08:24:32.477 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 51539607571 2026-02-17T08:24:32.477 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:24:32.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 51539607571 -lt 51539607571 2026-02-17T08:24:32.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:24:32.675 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-73014444049 2026-02-17T08:24:32.675 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:24:32.675 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:24:32.676 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-73014444049 2026-02-17T08:24:32.676 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:24:32.678 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=73014444049 2026-02-17T08:24:32.678 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 73014444049 2026-02-17T08:24:32.678 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 73014444049' 2026-02-17T08:24:32.678 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:24:32.877 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 73014444050 -lt 73014444049 2026-02-17T08:24:32.877 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:24:32.878 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-103079215120 2026-02-17T08:24:32.878 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:24:32.879 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:24:32.879 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-103079215120 2026-02-17T08:24:32.880 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:24:32.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=103079215120 2026-02-17T08:24:32.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 103079215120' 2026-02-17T08:24:32.881 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 103079215120 2026-02-17T08:24:32.882 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:24:33.075 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 103079215120 -lt 103079215120 2026-02-17T08:24:33.076 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:24:33.076 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-141733920782 2026-02-17T08:24:33.076 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:24:33.077 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:24:33.078 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-141733920782 2026-02-17T08:24:33.078 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:24:33.079 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=141733920782 2026-02-17T08:24:33.080 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.4 seq 141733920782 2026-02-17T08:24:33.080 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 141733920782' 2026-02-17T08:24:33.080 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:24:33.276 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 141733920782 -lt 141733920782 2026-02-17T08:24:33.277 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:24:33.277 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 5-180388626444 2026-02-17T08:24:33.278 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:24:33.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=5 2026-02-17T08:24:33.279 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 5-180388626444 2026-02-17T08:24:33.279 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:24:33.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=180388626444 2026-02-17T08:24:33.280 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.5 seq 180388626444 2026-02-17T08:24:33.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.5 seq 180388626444' 2026-02-17T08:24:33.281 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T08:24:33.488 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 180388626444 -lt 180388626444 2026-02-17T08:24:33.488 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:24:33.489 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 6-219043332106 2026-02-17T08:24:33.489 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:24:33.490 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=6 2026-02-17T08:24:33.490 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 6-219043332106 2026-02-17T08:24:33.491 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:24:33.492 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=219043332106 2026-02-17T08:24:33.492 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.6 seq 219043332106 2026-02-17T08:24:33.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.6 seq 219043332106' 2026-02-17T08:24:33.493 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T08:24:33.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 219043332107 -lt 219043332106 2026-02-17T08:24:33.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:24:33.701 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 8-292057776135 2026-02-17T08:24:33.701 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:24:33.702 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=8 2026-02-17T08:24:33.703 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 8-292057776135 2026-02-17T08:24:33.703 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:24:33.704 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=292057776135 2026-02-17T08:24:33.704 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.8 seq 292057776135 2026-02-17T08:24:33.705 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.8 seq 292057776135' 2026-02-17T08:24:33.705 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T08:24:33.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 292057776135 -lt 292057776135 2026-02-17T08:24:33.909 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:24:33.910 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:24:33.910 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:24:34.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:24:34.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:24:34.172 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:24:34.172 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:24:34.172 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:24:34.172 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:24:34.173 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:24:34.173 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:24:34.362 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:24:34.363 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:24:34.363 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:24:34.363 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:24:34.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:24:34.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:24:34.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:24:34.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:443: TEST_ec_recovery_multiple_errors: rados_get td/test-erasure-eio pool-jerasure myobject 2026-02-17T08:24:34.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:24:34.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:24:34.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=myobject 2026-02-17T08:24:34.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-17T08:24:34.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-17T08:24:34.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get myobject td/test-erasure-eio/COPY 2026-02-17T08:24:34.638 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-17T08:24:34.639 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-17T08:24:34.640 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:445: TEST_ec_recovery_multiple_errors: delete_erasure_coded_pool pool-jerasure 2026-02-17T08:24:34.640 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:24:34.640 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-17T08:24:34.887 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' does not exist 2026-02-17T08:24:34.897 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-17T08:24:35.149 INFO:tasks.workunit.client.0.trial059.stderr:erasure-code-profile myprofile does not exist 2026-02-17T08:24:35.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-17T08:24:35.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:24:35.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:24:35.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:24:35.159 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:24:35.159 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:24:35.160 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:24:35.160 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:24:35.160 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:24:35.474 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:24:35.474 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:24:35.475 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:24:35.476 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:24:35.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:24:35.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:24:35.478 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:24:35.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:24:35.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:24:35.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:24:35.480 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:24:35.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:24:35.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:24:35.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:24:35.509 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:24:35.509 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:24:35.509 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:24:35.509 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:24:35.511 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:24:35.511 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:24:35.511 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-17T08:24:35.511 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-17T08:24:35.511 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-eio 2026-02-17T08:24:35.512 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-eio 2026-02-17T08:24:35.512 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:24:35.512 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:24:35.512 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:24:35.512 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:24:35.512 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:24:35.512 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:24:35.512 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:24:35.512 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:24:35.513 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:24:35.514 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:24:35.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:24:35.515 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:24:35.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:24:35.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:24:35.516 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:24:35.517 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:24:35.517 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:24:35.518 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:24:35.518 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:24:35.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:24:35.520 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:24:35.520 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:24:35.522 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:24:35.522 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:24:35.522 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:24:35.522 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:24:35.523 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:24:35.524 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:24:35.524 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-eio 2026-02-17T08:24:35.525 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:24:35.525 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:24:35.525 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:24:35.525 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.70936 2026-02-17T08:24:35.527 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:24:35.528 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:24:35.528 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:24:35.528 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-17T08:24:35.529 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-17T08:24:35.529 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-eio 2026-02-17T08:24:35.529 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:24:35.529 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:24:35.529 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:24:35.529 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-eio/a 2026-02-17T08:24:35.529 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-17T08:24:35.550 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:24:35.550 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:24:35.550 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:24:35.550 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:24:35.550 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:24:35.551 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:24:35.551 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:24:35.551 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T08:24:35.580 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:24:35.581 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:24:35.581 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:24:35.581 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:24:35.581 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:24:35.583 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:24:35.583 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:24:35.583 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:24:35.583 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:24:35.583 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:24:35.583 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:24:35.583 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:24:35.583 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:24:35.584 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:24:35.584 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get fsid 2026-02-17T08:24:35.639 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:24:35.639 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:24:35.639 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:24:35.639 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:24:35.639 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:24:35.640 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:24:35.640 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:24:35.640 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:24:35.640 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:24:35.640 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:24:35.641 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:24:35.641 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:24:35.641 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:24:35.641 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get mon_host 2026-02-17T08:24:35.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-17T08:24:35.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-eio 2026-02-17T08:24:35.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:24:35.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:24:35.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:24:35.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-eio/x 2026-02-17T08:24:35.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:24:35.808 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:24:35.808 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:24:35.808 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:24:35.808 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:24:35.808 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:24:35.808 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:24:35.808 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:24:35.809 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:24:35.809 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:24:35.828 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-17T08:24:35.828 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T08:24:35.931 INFO:tasks.workunit.client.0.trial059.stderr:pool 'rbd' already exists 2026-02-17T08:24:35.938 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:24:36.940 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-17T08:24:36.940 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:24:36.940 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:24:36.941 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:24:36.941 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:24:36.941 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:24:36.941 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:24:36.941 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-17T08:24:36.941 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-mon.a.asok log flush 2026-02-17T08:24:36.991 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:24:36.997 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-17T08:24:36.998 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:24:35.558+0000 7f2bd7882ec0 0 load: jerasure load: lrc 2026-02-17T08:24:36.999 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_ec_recovery_multiple_objects td/test-erasure-eio 2026-02-17T08:24:36.999 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:451: TEST_ec_recovery_multiple_objects: local dir=td/test-erasure-eio 2026-02-17T08:24:36.999 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:452: TEST_ec_recovery_multiple_objects: local objname=myobject 2026-02-17T08:24:36.999 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:454: TEST_ec_recovery_multiple_objects: ORIG_ARGS='--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:24:36.999 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:455: TEST_ec_recovery_multiple_objects: CEPH_ARGS+=' --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-17T08:24:36.999 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:456: TEST_ec_recovery_multiple_objects: setup_osds 7 2026-02-17T08:24:36.999 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=7 2026-02-17T08:24:36.999 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-17T08:24:36.999 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 7 - 1 2026-02-17T08:24:37.000 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 6 2026-02-17T08:24:37.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:24:37.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-17T08:24:37.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:24:37.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:24:37.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:24:37.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:24:37.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-17T08:24:37.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-17T08:24:37.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:24:37.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:24:37.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:24:37.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-17T08:24:37.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-17T08:24:37.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:24:37.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:24:37.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:24:37.003 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:24:37.003 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:24:37.003 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:24:37.003 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:24:37.003 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:24:37.003 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:24:37.003 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:24:37.003 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:24:37.003 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:24:37.004 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:24:37.004 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:24:37.004 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:24:37.004 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:24:37.004 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:24:37.004 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:24:37.004 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:24:37.004 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:24:37.004 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:24:37.004 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:24:37.004 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-17T08:24:37.005 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:24:37.005 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=1faaf89c-9d84-4b7b-ba48-2fd624eb0afc 2026-02-17T08:24:37.006 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 1faaf89c-9d84-4b7b-ba48-2fd624eb0afc 2026-02-17T08:24:37.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 1faaf89c-9d84-4b7b-ba48-2fd624eb0afc' 2026-02-17T08:24:37.006 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:24:37.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDFJZRpBAKiABAAp0iqJPK1eAFONgcfObi1DQ== 2026-02-17T08:24:37.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDFJZRpBAKiABAAp0iqJPK1eAFONgcfObi1DQ=="}' 2026-02-17T08:24:37.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 1faaf89c-9d84-4b7b-ba48-2fd624eb0afc -i td/test-erasure-eio/0/new.json 2026-02-17T08:24:37.129 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:24:37.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-17T08:24:37.138 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDFJZRpBAKiABAAp0iqJPK1eAFONgcfObi1DQ== --osd-uuid 1faaf89c-9d84-4b7b-ba48-2fd624eb0afc 2026-02-17T08:24:37.156 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:37.142+0000 7fe2825758c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:37.157 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:37.146+0000 7fe2825758c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:37.159 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:37.146+0000 7fe2825758c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:37.159 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:37.146+0000 7fe2825758c0 -1 bdev(0x558250fc1c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:24:37.160 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:37.146+0000 7fe2825758c0 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-17T08:24:39.938 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-17T08:24:39.939 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:24:39.939 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:24:39.940 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:24:39.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:24:40.209 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:24:40.210 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:24:40.211 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:24:40.211 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:24:40.211 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:24:40.211 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:24:40.227 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:40.214+0000 7f99f540a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:40.228 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:40.214+0000 7f99f540a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:40.229 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:40.214+0000 7f99f540a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:40.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:24:40.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:24:40.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:24:40.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:24:40.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:24:40.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:40.413 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:24:40.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:24:40.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:40.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:24:40.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:24:41.612 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:24:41.612 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:41.613 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:24:41.613 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:24:41.614 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:41.614 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:24:41.735 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:41.722+0000 7f99f540a8c0 -1 Falling back to public interface 2026-02-17T08:24:41.809 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:24:42.812 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:24:42.812 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:42.812 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:24:42.814 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:24:42.814 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:42.814 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:24:43.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:24:44.009 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:24:44.009 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:44.009 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:24:44.010 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:24:44.010 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:44.010 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:24:44.204 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:24:44.814 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:44.806+0000 7f99f540a8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:24:45.205 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:24:45.206 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:45.206 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:24:45.207 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:24:45.207 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:45.207 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:24:45.404 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:24:46.405 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:24:46.405 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:46.406 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:24:46.406 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:24:46.406 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:46.406 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:24:46.602 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1872031360,v1:127.0.0.1:6803/1872031360] [v2:127.0.0.1:6804/1872031360,v1:127.0.0.1:6805/1872031360] exists,up 1faaf89c-9d84-4b7b-ba48-2fd624eb0afc 2026-02-17T08:24:46.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:24:46.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:24:46.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:24:46.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:24:46.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-17T08:24:46.607 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:24:46.607 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:24:46.607 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T08:24:46.607 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:24:46.607 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-17T08:24:46.607 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-17T08:24:46.607 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:24:46.607 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:24:46.607 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:24:46.607 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-17T08:24:46.607 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-17T08:24:46.607 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:24:46.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:24:46.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:24:46.608 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:24:46.608 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:24:46.608 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:24:46.608 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:24:46.608 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:24:46.608 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:24:46.608 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:24:46.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:24:46.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:24:46.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:24:46.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:24:46.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:24:46.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:24:46.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:24:46.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:24:46.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:24:46.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:24:46.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:24:46.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:24:46.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-17T08:24:46.609 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:24:46.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=4a515f98-224c-4e1a-bbb2-2ed8f7df6436 2026-02-17T08:24:46.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 4a515f98-224c-4e1a-bbb2-2ed8f7df6436' 2026-02-17T08:24:46.610 INFO:tasks.workunit.client.0.trial059.stdout:add osd1 4a515f98-224c-4e1a-bbb2-2ed8f7df6436 2026-02-17T08:24:46.611 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:24:46.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDOJZRptJOBJBAAMhFqRFgKS1kCBT954qx5sw== 2026-02-17T08:24:46.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDOJZRptJOBJBAAMhFqRFgKS1kCBT954qx5sw=="}' 2026-02-17T08:24:46.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 4a515f98-224c-4e1a-bbb2-2ed8f7df6436 -i td/test-erasure-eio/1/new.json 2026-02-17T08:24:46.814 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:24:46.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-17T08:24:46.824 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDOJZRptJOBJBAAMhFqRFgKS1kCBT954qx5sw== --osd-uuid 4a515f98-224c-4e1a-bbb2-2ed8f7df6436 2026-02-17T08:24:46.841 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:46.830+0000 7f110bbd48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:46.842 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:46.834+0000 7f110bbd48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:46.843 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:46.834+0000 7f110bbd48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:46.844 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:46.834+0000 7f110bbd48c0 -1 bdev(0x55a9c676bc00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-17T08:24:46.844 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:46.834+0000 7f110bbd48c0 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-17T08:24:49.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-17T08:24:49.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:24:49.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T08:24:49.109 INFO:tasks.workunit.client.0.trial059.stdout:adding osd1 key to auth repository 2026-02-17T08:24:49.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:24:49.377 INFO:tasks.workunit.client.0.trial059.stdout:start osd.1 2026-02-17T08:24:49.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T08:24:49.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:24:49.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:24:49.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:24:49.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:24:49.403 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:49.394+0000 7fdaad7b38c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:49.404 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:49.394+0000 7fdaad7b38c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:49.405 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:49.398+0000 7fdaad7b38c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:49.581 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T08:24:49.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:24:49.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:24:49.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:24:49.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:24:49.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:49.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:24:49.582 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:24:49.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:49.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:24:49.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:24:50.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:24:50.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:50.782 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:24:50.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:24:50.784 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:50.784 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:24:50.895 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:50.885+0000 7fdaad7b38c0 -1 Falling back to public interface 2026-02-17T08:24:50.978 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:24:51.980 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:24:51.980 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:51.980 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:24:51.981 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:24:51.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:51.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:24:52.175 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:24:53.176 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:24:53.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:53.177 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:24:53.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:24:53.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:53.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:24:53.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:24:54.152 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:54.141+0000 7fdaad7b38c0 -1 osd.1 0 log_to_monitors true 2026-02-17T08:24:54.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:24:54.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:54.372 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:24:54.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:24:54.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:54.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:24:54.570 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:24:55.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:24:55.572 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:24:55.573 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:55.573 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:24:55.573 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:55.573 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:24:55.769 INFO:tasks.workunit.client.0.trial059.stdout:osd.1 up in weight 1 up_from 12 up_thru 12 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3508801249,v1:127.0.0.1:6811/3508801249] [v2:127.0.0.1:6812/3508801249,v1:127.0.0.1:6813/3508801249] exists,up 4a515f98-224c-4e1a-bbb2-2ed8f7df6436 2026-02-17T08:24:55.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:24:55.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:24:55.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:24:55.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:24:55.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-17T08:24:55.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:24:55.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:24:55.775 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T08:24:55.775 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:24:55.775 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-17T08:24:55.775 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-17T08:24:55.775 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:24:55.775 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:24:55.775 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:24:55.775 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-17T08:24:55.775 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-17T08:24:55.775 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:24:55.775 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:24:55.775 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:24:55.776 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:24:55.776 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:24:55.776 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:24:55.776 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:24:55.776 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:24:55.776 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:24:55.776 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:24:55.776 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:24:55.776 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:24:55.776 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:24:55.776 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:24:55.776 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:24:55.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:24:55.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:24:55.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:24:55.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:24:55.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:24:55.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:24:55.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:24:55.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-17T08:24:55.777 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:24:55.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=f55a16c4-e708-453a-b6b8-eb2407bb700b 2026-02-17T08:24:55.778 INFO:tasks.workunit.client.0.trial059.stdout:add osd2 f55a16c4-e708-453a-b6b8-eb2407bb700b 2026-02-17T08:24:55.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 f55a16c4-e708-453a-b6b8-eb2407bb700b' 2026-02-17T08:24:55.779 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:24:55.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDXJZRpCINYLhAA42UfbxYqrngdLQSBMzhrCg== 2026-02-17T08:24:55.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDXJZRpCINYLhAA42UfbxYqrngdLQSBMzhrCg=="}' 2026-02-17T08:24:55.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new f55a16c4-e708-453a-b6b8-eb2407bb700b -i td/test-erasure-eio/2/new.json 2026-02-17T08:24:55.983 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:24:55.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-17T08:24:55.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDXJZRpCINYLhAA42UfbxYqrngdLQSBMzhrCg== --osd-uuid f55a16c4-e708-453a-b6b8-eb2407bb700b 2026-02-17T08:24:56.009 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:55.997+0000 7fb92bd2c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:56.011 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:56.001+0000 7fb92bd2c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:56.012 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:56.001+0000 7fb92bd2c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:56.012 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:56.001+0000 7fb92bd2c8c0 -1 bdev(0x5609ca891c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-17T08:24:56.012 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:56.001+0000 7fb92bd2c8c0 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-17T08:24:58.274 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-17T08:24:58.275 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:24:58.275 INFO:tasks.workunit.client.0.trial059.stdout:adding osd2 key to auth repository 2026-02-17T08:24:58.276 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T08:24:58.276 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:24:58.551 INFO:tasks.workunit.client.0.trial059.stdout:start osd.2 2026-02-17T08:24:58.552 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T08:24:58.552 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:24:58.552 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:24:58.552 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:24:58.552 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:24:58.568 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:58.557+0000 7fc60561d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:58.569 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:58.557+0000 7fc60561d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:58.570 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:24:58.561+0000 7fc60561d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:24:58.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T08:24:58.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:24:58.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:24:58.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:24:58.756 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:24:58.757 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:24:58.757 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:58.757 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:24:58.757 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:58.758 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:24:58.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:24:59.952 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:24:59.952 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:24:59.953 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:24:59.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:24:59.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:24:59.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:25:00.139 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:00.129+0000 7fc60561d8c0 -1 Falling back to public interface 2026-02-17T08:25:00.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:01.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:01.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:01.150 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:25:01.151 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:25:01.151 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:01.151 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:25:01.346 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:02.348 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:02.348 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:02.348 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:25:02.349 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:25:02.349 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:02.349 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:25:02.541 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:03.176 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:03.165+0000 7fc60561d8c0 -1 osd.2 0 log_to_monitors true 2026-02-17T08:25:03.543 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:03.543 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:03.543 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:25:03.543 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:25:03.544 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:03.544 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:25:03.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:04.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:04.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:04.753 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:25:04.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:25:04.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:04.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:25:04.948 INFO:tasks.workunit.client.0.trial059.stdout:osd.2 up in weight 1 up_from 18 up_thru 20 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2899081208,v1:127.0.0.1:6819/2899081208] [v2:127.0.0.1:6820/2899081208,v1:127.0.0.1:6821/2899081208] exists,up f55a16c4-e708-453a-b6b8-eb2407bb700b 2026-02-17T08:25:04.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:25:04.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:25:04.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:25:04.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:25:04.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-17T08:25:04.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:25:04.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:25:04.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2026-02-17T08:25:04.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:25:04.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-17T08:25:04.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-17T08:25:04.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:25:04.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:25:04.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:25:04.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-17T08:25:04.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-17T08:25:04.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:25:04.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:25:04.955 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:25:04.955 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:25:04.955 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:25:04.955 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:25:04.955 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:25:04.955 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:25:04.955 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:25:04.955 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:25:04.955 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:25:04.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:25:04.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:25:04.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:25:04.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:25:04.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:25:04.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:25:04.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:25:04.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:25:04.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:25:04.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:25:04.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:25:04.957 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-17T08:25:04.957 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:25:04.957 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=53b1bd60-6cf7-43ea-856b-3d0afd7a5dfc 2026-02-17T08:25:04.957 INFO:tasks.workunit.client.0.trial059.stdout:add osd3 53b1bd60-6cf7-43ea-856b-3d0afd7a5dfc 2026-02-17T08:25:04.958 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 53b1bd60-6cf7-43ea-856b-3d0afd7a5dfc' 2026-02-17T08:25:04.958 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:25:04.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDgJZRpZ6sJORAA1oBn3CXiVU9W7IkPTwW6pQ== 2026-02-17T08:25:04.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDgJZRpZ6sJORAA1oBn3CXiVU9W7IkPTwW6pQ=="}' 2026-02-17T08:25:04.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 53b1bd60-6cf7-43ea-856b-3d0afd7a5dfc -i td/test-erasure-eio/3/new.json 2026-02-17T08:25:05.173 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:25:05.182 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-17T08:25:05.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDgJZRpZ6sJORAA1oBn3CXiVU9W7IkPTwW6pQ== --osd-uuid 53b1bd60-6cf7-43ea-856b-3d0afd7a5dfc 2026-02-17T08:25:05.208 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:05.197+0000 7ff45acf08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:05.209 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:05.197+0000 7ff45acf08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:05.210 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:05.201+0000 7ff45acf08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:05.211 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:05.201+0000 7ff45acf08c0 -1 bdev(0x564793343c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-17T08:25:05.211 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:05.201+0000 7ff45acf08c0 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-17T08:25:07.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-17T08:25:07.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:25:07.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2026-02-17T08:25:07.497 INFO:tasks.workunit.client.0.trial059.stdout:adding osd3 key to auth repository 2026-02-17T08:25:07.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:25:07.764 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2026-02-17T08:25:07.764 INFO:tasks.workunit.client.0.trial059.stdout:start osd.3 2026-02-17T08:25:07.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:25:07.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:25:07.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:25:07.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:25:07.791 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:07.781+0000 7fe357a2c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:07.792 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:07.781+0000 7fe357a2c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:07.793 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:07.781+0000 7fe357a2c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:07.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2026-02-17T08:25:07.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:25:07.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T08:25:07.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:25:07.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:25:07.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:07.966 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:25:07.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:25:07.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:07.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:25:08.158 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:09.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:09.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:09.159 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:25:09.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:25:09.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:09.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:25:09.303 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:09.293+0000 7fe357a2c8c0 -1 Falling back to public interface 2026-02-17T08:25:09.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:10.362 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:10.362 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:10.362 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:25:10.362 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:25:10.362 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:10.363 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:25:10.566 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:11.567 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:11.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:11.568 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:25:11.569 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:25:11.569 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:11.569 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:25:11.762 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:12.313 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:12.301+0000 7fe357a2c8c0 -1 osd.3 0 log_to_monitors true 2026-02-17T08:25:12.764 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:12.764 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:12.764 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:25:12.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:25:12.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:12.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:25:12.962 INFO:tasks.workunit.client.0.trial059.stdout:osd.3 up in weight 1 up_from 27 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/731932472,v1:127.0.0.1:6827/731932472] [v2:127.0.0.1:6828/731932472,v1:127.0.0.1:6829/731932472] exists,up 53b1bd60-6cf7-43ea-856b-3d0afd7a5dfc 2026-02-17T08:25:12.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:25:12.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:25:12.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:25:12.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:25:12.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 4 2026-02-17T08:25:12.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:25:12.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:25:12.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2026-02-17T08:25:12.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:25:12.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/4 2026-02-17T08:25:12.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-17T08:25:12.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:25:12.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:25:12.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:25:12.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/4' 2026-02-17T08:25:12.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/4/journal' 2026-02-17T08:25:12.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:25:12.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:25:12.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:25:12.967 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:25:12.967 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:25:12.967 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:25:12.967 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:25:12.967 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:25:12.967 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:25:12.967 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:25:12.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:25:12.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:25:12.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:25:12.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:25:12.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:25:12.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:25:12.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:25:12.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:25:12.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:25:12.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:25:12.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:25:12.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:25:12.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/4 2026-02-17T08:25:12.969 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:25:12.969 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=6118b88d-2e3c-4cf6-a22a-c76bd943f2ca 2026-02-17T08:25:12.969 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 6118b88d-2e3c-4cf6-a22a-c76bd943f2ca' 2026-02-17T08:25:12.970 INFO:tasks.workunit.client.0.trial059.stdout:add osd4 6118b88d-2e3c-4cf6-a22a-c76bd943f2ca 2026-02-17T08:25:12.970 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:25:12.980 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDoJZRpkt/nORAA76FrF4L7LYV5xTukVw7F3w== 2026-02-17T08:25:12.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDoJZRpkt/nORAA76FrF4L7LYV5xTukVw7F3w=="}' 2026-02-17T08:25:12.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 6118b88d-2e3c-4cf6-a22a-c76bd943f2ca -i td/test-erasure-eio/4/new.json 2026-02-17T08:25:13.185 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:25:13.194 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/4/new.json 2026-02-17T08:25:13.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDoJZRpkt/nORAA76FrF4L7LYV5xTukVw7F3w== --osd-uuid 6118b88d-2e3c-4cf6-a22a-c76bd943f2ca 2026-02-17T08:25:13.213 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:13.201+0000 7feaaaabd8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:13.214 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:13.201+0000 7feaaaabd8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:13.215 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:13.205+0000 7feaaaabd8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:13.216 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:13.205+0000 7feaaaabd8c0 -1 bdev(0x563b464b9c00 td/test-erasure-eio/4/block) open stat got: (1) Operation not permitted 2026-02-17T08:25:13.216 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:13.205+0000 7feaaaabd8c0 -1 bluestore(td/test-erasure-eio/4) _read_fsid unparsable uuid 2026-02-17T08:25:15.507 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/4/keyring 2026-02-17T08:25:15.507 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:25:15.508 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2026-02-17T08:25:15.508 INFO:tasks.workunit.client.0.trial059.stdout:adding osd4 key to auth repository 2026-02-17T08:25:15.509 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:25:15.771 INFO:tasks.workunit.client.0.trial059.stdout:start osd.4 2026-02-17T08:25:15.772 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2026-02-17T08:25:15.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:25:15.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:25:15.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:25:15.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:25:15.787 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:15.777+0000 7fa17de578c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:15.789 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:15.777+0000 7fa17de578c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:15.790 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:15.777+0000 7fa17de578c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:15.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2026-02-17T08:25:15.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:25:15.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2026-02-17T08:25:15.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:25:15.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:25:15.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:15.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:25:15.975 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:25:15.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:15.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:25:16.170 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:17.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:17.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:17.172 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:25:17.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:25:17.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:17.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:25:17.280 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:17.269+0000 7fa17de578c0 -1 Falling back to public interface 2026-02-17T08:25:17.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:18.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:18.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:18.372 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:25:18.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:25:18.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:18.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:25:18.573 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:19.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:19.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:19.575 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:25:19.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:25:19.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:19.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:25:19.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:20.330 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:20.321+0000 7fa17de578c0 -1 osd.4 0 log_to_monitors true 2026-02-17T08:25:20.776 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:20.776 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:20.776 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:25:20.777 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:25:20.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:20.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:25:20.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:21.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:21.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:21.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:25:21.973 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:25:21.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:21.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:25:22.167 INFO:tasks.workunit.client.0.trial059.stdout:osd.4 up in weight 1 up_from 36 up_thru 37 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/3799758583,v1:127.0.0.1:6835/3799758583] [v2:127.0.0.1:6836/3799758583,v1:127.0.0.1:6837/3799758583] exists,up 6118b88d-2e3c-4cf6-a22a-c76bd943f2ca 2026-02-17T08:25:22.170 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:25:22.170 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:25:22.170 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:25:22.170 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:25:22.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 5 2026-02-17T08:25:22.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:25:22.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:25:22.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=5 2026-02-17T08:25:22.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:25:22.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/5 2026-02-17T08:25:22.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-17T08:25:22.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:25:22.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:25:22.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:25:22.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/5' 2026-02-17T08:25:22.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/5/journal' 2026-02-17T08:25:22.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:25:22.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:25:22.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:25:22.172 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:25:22.172 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:25:22.172 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:25:22.172 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:25:22.172 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:25:22.172 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:25:22.172 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:25:22.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:25:22.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:25:22.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:25:22.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:25:22.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:25:22.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:25:22.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:25:22.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:25:22.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:25:22.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:25:22.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:25:22.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:25:22.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/5 2026-02-17T08:25:22.173 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:25:22.174 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=cc0d1a51-d6ea-4d84-a621-e9aa7fffd829 2026-02-17T08:25:22.174 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd5 cc0d1a51-d6ea-4d84-a621-e9aa7fffd829' 2026-02-17T08:25:22.174 INFO:tasks.workunit.client.0.trial059.stdout:add osd5 cc0d1a51-d6ea-4d84-a621-e9aa7fffd829 2026-02-17T08:25:22.175 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:25:22.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDyJZRpJ3ZyChAASjjBBYxp5fNOgY0y/l/7hQ== 2026-02-17T08:25:22.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDyJZRpJ3ZyChAASjjBBYxp5fNOgY0y/l/7hQ=="}' 2026-02-17T08:25:22.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new cc0d1a51-d6ea-4d84-a621-e9aa7fffd829 -i td/test-erasure-eio/5/new.json 2026-02-17T08:25:22.382 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:25:22.392 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/5/new.json 2026-02-17T08:25:22.392 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 5 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDyJZRpJ3ZyChAASjjBBYxp5fNOgY0y/l/7hQ== --osd-uuid cc0d1a51-d6ea-4d84-a621-e9aa7fffd829 2026-02-17T08:25:22.409 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:22.396+0000 7f98983b78c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:22.411 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:22.400+0000 7f98983b78c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:22.412 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:22.400+0000 7f98983b78c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:22.412 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:22.400+0000 7f98983b78c0 -1 bdev(0x55b48b273c00 td/test-erasure-eio/5/block) open stat got: (1) Operation not permitted 2026-02-17T08:25:22.412 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:22.400+0000 7f98983b78c0 -1 bluestore(td/test-erasure-eio/5) _read_fsid unparsable uuid 2026-02-17T08:25:24.699 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/5/keyring 2026-02-17T08:25:24.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:25:24.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd5 key to auth repository 2026-02-17T08:25:24.701 INFO:tasks.workunit.client.0.trial059.stdout:adding osd5 key to auth repository 2026-02-17T08:25:24.701 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:25:24.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.5 2026-02-17T08:25:24.972 INFO:tasks.workunit.client.0.trial059.stdout:start osd.5 2026-02-17T08:25:24.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 5 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:25:24.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:25:24.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:25:24.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:25:24.997 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:24.984+0000 7f93599e38c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:24.999 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:24.988+0000 7f93599e38c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:25.000 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:24.988+0000 7f93599e38c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:25.174 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 5 2026-02-17T08:25:25.174 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:25:25.174 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=5 2026-02-17T08:25:25.174 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:25:25.174 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:25:25.175 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:25.175 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:25:25.175 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:25:25.176 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:25.176 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:25:25.370 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:26.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:26.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:26.371 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:25:26.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:25:26.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:26.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:25:26.508 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:26.496+0000 7f93599e38c0 -1 Falling back to public interface 2026-02-17T08:25:26.571 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:27.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:27.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:27.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:25:27.573 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:25:27.573 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:27.573 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:25:27.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:28.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:28.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:28.769 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:25:28.769 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:25:28.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:28.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:25:28.964 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:29.764 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:29.752+0000 7f93599e38c0 -1 osd.5 0 log_to_monitors true 2026-02-17T08:25:29.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:29.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:29.966 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:25:29.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:25:29.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:29.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:25:30.174 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:31.176 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:31.176 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:31.177 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:25:31.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:25:31.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:31.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:25:31.373 INFO:tasks.workunit.client.0.trial059.stdout:osd.5 up in weight 1 up_from 44 up_thru 45 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/134494263,v1:127.0.0.1:6843/134494263] [v2:127.0.0.1:6844/134494263,v1:127.0.0.1:6845/134494263] exists,up cc0d1a51-d6ea-4d84-a621-e9aa7fffd829 2026-02-17T08:25:31.376 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:25:31.376 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:25:31.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:25:31.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:25:31.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 6 2026-02-17T08:25:31.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:25:31.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:25:31.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=6 2026-02-17T08:25:31.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:25:31.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/6 2026-02-17T08:25:31.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-17T08:25:31.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:25:31.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:25:31.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:25:31.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/6' 2026-02-17T08:25:31.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/6/journal' 2026-02-17T08:25:31.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:25:31.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:25:31.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:25:31.378 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:25:31.378 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:25:31.378 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:25:31.378 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:25:31.378 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:25:31.379 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:25:31.379 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:25:31.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:25:31.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:25:31.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:25:31.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:25:31.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:25:31.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:25:31.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:25:31.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:25:31.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:25:31.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:25:31.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:25:31.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:25:31.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/6 2026-02-17T08:25:31.380 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:25:31.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=662534e9-9964-4888-b9ad-27fcfc80e38b 2026-02-17T08:25:31.381 INFO:tasks.workunit.client.0.trial059.stdout:add osd6 662534e9-9964-4888-b9ad-27fcfc80e38b 2026-02-17T08:25:31.381 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd6 662534e9-9964-4888-b9ad-27fcfc80e38b' 2026-02-17T08:25:31.381 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:25:31.391 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQD7JZRpff23FhAAy4KfqVzRajWvsSt0z814Ag== 2026-02-17T08:25:31.391 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQD7JZRpff23FhAAy4KfqVzRajWvsSt0z814Ag=="}' 2026-02-17T08:25:31.391 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 662534e9-9964-4888-b9ad-27fcfc80e38b -i td/test-erasure-eio/6/new.json 2026-02-17T08:25:31.591 INFO:tasks.workunit.client.0.trial059.stdout:6 2026-02-17T08:25:31.600 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/6/new.json 2026-02-17T08:25:31.601 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 6 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD7JZRpff23FhAAy4KfqVzRajWvsSt0z814Ag== --osd-uuid 662534e9-9964-4888-b9ad-27fcfc80e38b 2026-02-17T08:25:31.618 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:31.604+0000 7fae7c3568c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:31.619 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:31.608+0000 7fae7c3568c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:31.620 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:31.608+0000 7fae7c3568c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:31.620 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:31.608+0000 7fae7c3568c0 -1 bdev(0x556f2b6ddc00 td/test-erasure-eio/6/block) open stat got: (1) Operation not permitted 2026-02-17T08:25:31.621 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:31.608+0000 7fae7c3568c0 -1 bluestore(td/test-erasure-eio/6) _read_fsid unparsable uuid 2026-02-17T08:25:33.903 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/6/keyring 2026-02-17T08:25:33.903 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:25:33.904 INFO:tasks.workunit.client.0.trial059.stdout:adding osd6 key to auth repository 2026-02-17T08:25:33.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd6 key to auth repository 2026-02-17T08:25:33.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:25:34.176 INFO:tasks.workunit.client.0.trial059.stdout:start osd.6 2026-02-17T08:25:34.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.6 2026-02-17T08:25:34.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 6 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:25:34.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:25:34.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:25:34.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:25:34.202 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:34.188+0000 7f71fdbee8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:34.204 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:34.192+0000 7f71fdbee8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:34.205 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:34.192+0000 7f71fdbee8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:34.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 6 2026-02-17T08:25:34.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:25:34.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=6 2026-02-17T08:25:34.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:25:34.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:25:34.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:34.378 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:25:34.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:25:34.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:34.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:25:34.580 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:35.581 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:35.581 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:35.582 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:25:35.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:25:35.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:35.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:25:35.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:35.916 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:35.904+0000 7f71fdbee8c0 -1 Falling back to public interface 2026-02-17T08:25:36.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:36.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:36.781 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:25:36.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:25:36.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:36.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:25:36.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:37.980 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:37.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:37.981 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:25:37.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:25:37.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:37.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:25:38.174 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:38.991 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:38.976+0000 7f71fdbee8c0 -1 osd.6 0 log_to_monitors true 2026-02-17T08:25:39.176 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:39.176 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:39.177 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:25:39.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:25:39.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:39.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:25:39.387 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:40.389 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:40.389 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:40.389 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:25:40.389 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:25:40.390 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:40.390 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:25:40.584 INFO:tasks.workunit.client.0.trial059.stdout:osd.6 up in weight 1 up_from 52 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/3155877837,v1:127.0.0.1:6851/3155877837] [v2:127.0.0.1:6852/3155877837,v1:127.0.0.1:6853/3155877837] exists,up 662534e9-9964-4888-b9ad-27fcfc80e38b 2026-02-17T08:25:40.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:25:40.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:25:40.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:25:40.586 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-17T08:25:40.586 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:25:40.586 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:25:40.586 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:25:40.586 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:25:40.587 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:25:40.587 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.0.asok 2026-02-17T08:25:40.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-17T08:25:40.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.0.asok log flush 2026-02-17T08:25:40.639 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:25:40.644 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-17T08:25:40.647 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:24:41.726+0000 7f99f540a8c0 0 load: jerasure load: lrc 2026-02-17T08:25:40.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:457: TEST_ec_recovery_multiple_objects: CEPH_ARGS='--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:25:40.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:459: TEST_ec_recovery_multiple_objects: local poolname=pool-jerasure 2026-02-17T08:25:40.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:460: TEST_ec_recovery_multiple_objects: create_erasure_coded_pool pool-jerasure 3 2 2026-02-17T08:25:40.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:25:40.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-17T08:25:40.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=3 2026-02-17T08:25:40.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-17T08:25:40.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=2 2026-02-17T08:25:40.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-17T08:25:40.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=3 m=2 crush-failure-domain=osd 2026-02-17T08:25:40.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-17T08:25:40.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-17T08:25:41.293 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' already exists 2026-02-17T08:25:41.303 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:25:42.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-17T08:25:42.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:25:42.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:25:42.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:25:42.305 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:25:42.306 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:25:42.306 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:25:42.306 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:25:42.306 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:25:42.306 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:25:42.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:25:42.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:25:42.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:25:42.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:25:42.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:25:42.416 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:25:42.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:25:42.612 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:25:42.612 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:25:42.612 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:25:42.612 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:25:42.612 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:25:42.612 INFO:tasks.workunit.client.0.trial059.stderr:6' 2026-02-17T08:25:42.612 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:25:42.612 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:25:42.613 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:25:42.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803790 2026-02-17T08:25:42.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803790 2026-02-17T08:25:42.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803790' 2026-02-17T08:25:42.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:25:42.689 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:25:42.763 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=51539607564 2026-02-17T08:25:42.764 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 51539607564 2026-02-17T08:25:42.764 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803790 1-51539607564' 2026-02-17T08:25:42.764 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:25:42.764 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:25:42.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411338 2026-02-17T08:25:42.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411338 2026-02-17T08:25:42.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803790 1-51539607564 2-77309411338' 2026-02-17T08:25:42.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:25:42.840 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:25:42.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=115964117000 2026-02-17T08:25:42.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 115964117000 2026-02-17T08:25:42.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803790 1-51539607564 2-77309411338 3-115964117000' 2026-02-17T08:25:42.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:25:42.918 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:25:42.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=154618822663 2026-02-17T08:25:42.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 154618822663 2026-02-17T08:25:42.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803790 1-51539607564 2-77309411338 3-115964117000 4-154618822663' 2026-02-17T08:25:42.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:25:42.995 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-17T08:25:43.067 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=188978561029 2026-02-17T08:25:43.068 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 188978561029 2026-02-17T08:25:43.068 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803790 1-51539607564 2-77309411338 3-115964117000 4-154618822663 5-188978561029' 2026-02-17T08:25:43.068 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:25:43.068 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-17T08:25:43.145 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=223338299395 2026-02-17T08:25:43.145 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 223338299395 2026-02-17T08:25:43.145 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803790 1-51539607564 2-77309411338 3-115964117000 4-154618822663 5-188978561029 6-223338299395' 2026-02-17T08:25:43.145 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:25:43.145 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803790 2026-02-17T08:25:43.146 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:25:43.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:25:43.147 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803790 2026-02-17T08:25:43.147 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:25:43.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803790 2026-02-17T08:25:43.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803790' 2026-02-17T08:25:43.149 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 25769803790 2026-02-17T08:25:43.150 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:25:43.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803788 -lt 25769803790 2026-02-17T08:25:43.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:25:44.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:25:44.356 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:25:44.552 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803790 -lt 25769803790 2026-02-17T08:25:44.552 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:25:44.552 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-51539607564 2026-02-17T08:25:44.553 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:25:44.554 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:25:44.554 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-51539607564 2026-02-17T08:25:44.554 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:25:44.556 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=51539607564 2026-02-17T08:25:44.556 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 51539607564' 2026-02-17T08:25:44.556 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 51539607564 2026-02-17T08:25:44.556 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:25:44.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 51539607564 -lt 51539607564 2026-02-17T08:25:44.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:25:44.757 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-77309411338 2026-02-17T08:25:44.757 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:25:44.758 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:25:44.759 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-77309411338 2026-02-17T08:25:44.759 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:25:44.760 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411338 2026-02-17T08:25:44.760 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 77309411338' 2026-02-17T08:25:44.760 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 77309411338 2026-02-17T08:25:44.760 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:25:44.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411338 -lt 77309411338 2026-02-17T08:25:44.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:25:44.968 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-115964117000 2026-02-17T08:25:44.969 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:25:44.970 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:25:44.971 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-115964117000 2026-02-17T08:25:44.971 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:25:44.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=115964117000 2026-02-17T08:25:44.972 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 115964117000 2026-02-17T08:25:44.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 115964117000' 2026-02-17T08:25:44.972 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:25:45.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 115964117001 -lt 115964117000 2026-02-17T08:25:45.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:25:45.181 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-154618822663 2026-02-17T08:25:45.181 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:25:45.182 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:25:45.183 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-154618822663 2026-02-17T08:25:45.183 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:25:45.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=154618822663 2026-02-17T08:25:45.184 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.4 seq 154618822663 2026-02-17T08:25:45.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 154618822663' 2026-02-17T08:25:45.185 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:25:45.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 154618822663 -lt 154618822663 2026-02-17T08:25:45.381 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:25:45.381 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 5-188978561029 2026-02-17T08:25:45.381 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:25:45.382 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=5 2026-02-17T08:25:45.383 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 5-188978561029 2026-02-17T08:25:45.383 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:25:45.384 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=188978561029 2026-02-17T08:25:45.384 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.5 seq 188978561029' 2026-02-17T08:25:45.385 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.5 seq 188978561029 2026-02-17T08:25:45.385 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T08:25:45.591 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 188978561029 -lt 188978561029 2026-02-17T08:25:45.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:25:45.592 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 6-223338299395 2026-02-17T08:25:45.593 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:25:45.594 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=6 2026-02-17T08:25:45.595 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 6-223338299395 2026-02-17T08:25:45.595 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:25:45.596 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=223338299395 2026-02-17T08:25:45.596 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.6 seq 223338299395 2026-02-17T08:25:45.597 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.6 seq 223338299395' 2026-02-17T08:25:45.597 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T08:25:45.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 223338299395 -lt 223338299395 2026-02-17T08:25:45.790 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:25:45.790 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:25:45.790 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:25:46.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:25:46.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:25:46.043 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:25:46.044 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:25:46.044 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:25:46.044 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:25:46.044 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:25:46.044 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:25:46.234 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:25:46.234 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:25:46.235 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:25:46.235 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:25:46.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:25:46.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:25:46.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:25:46.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:462: TEST_ec_recovery_multiple_objects: rados_put td/test-erasure-eio pool-jerasure test1 2026-02-17T08:25:46.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-17T08:25:46.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-17T08:25:46.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=test1 2026-02-17T08:25:46.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:25:46.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-17T08:25:46.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:25:46.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-17T08:25:46.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:25:46.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-17T08:25:46.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:25:46.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-17T08:25:46.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put test1 td/test-erasure-eio/ORIGINAL 2026-02-17T08:25:46.518 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:463: TEST_ec_recovery_multiple_objects: rados_put td/test-erasure-eio pool-jerasure test2 2026-02-17T08:25:46.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-17T08:25:46.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-17T08:25:46.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=test2 2026-02-17T08:25:46.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:25:46.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-17T08:25:46.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:25:46.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-17T08:25:46.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:25:46.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-17T08:25:46.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:25:46.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-17T08:25:46.520 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put test2 td/test-erasure-eio/ORIGINAL 2026-02-17T08:25:46.536 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:464: TEST_ec_recovery_multiple_objects: rados_put td/test-erasure-eio pool-jerasure test3 2026-02-17T08:25:46.537 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-17T08:25:46.537 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-17T08:25:46.537 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=test3 2026-02-17T08:25:46.537 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:25:46.537 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-17T08:25:46.537 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:25:46.537 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-17T08:25:46.537 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:25:46.537 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-17T08:25:46.538 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:25:46.538 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-17T08:25:46.538 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put test3 td/test-erasure-eio/ORIGINAL 2026-02-17T08:25:46.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:466: TEST_ec_recovery_multiple_objects: ceph osd out 0 2026-02-17T08:25:46.805 INFO:tasks.workunit.client.0.trial059.stderr:osd.0 is already out. 2026-02-17T08:25:46.814 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:469: TEST_ec_recovery_multiple_objects: wait_for_clean 2026-02-17T08:25:46.814 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:25:46.815 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:25:46.815 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:25:46.815 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:25:46.816 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:25:46.816 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:25:46.816 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:25:46.816 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:25:46.816 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:25:46.925 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:25:46.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:25:46.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:25:46.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:25:46.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:25:46.926 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:25:47.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:25:47.122 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:25:47.123 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:25:47.123 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:25:47.123 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:25:47.123 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:25:47.123 INFO:tasks.workunit.client.0.trial059.stderr:6' 2026-02-17T08:25:47.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:25:47.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:25:47.123 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:25:47.197 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803793 2026-02-17T08:25:47.197 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803793 2026-02-17T08:25:47.197 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793' 2026-02-17T08:25:47.197 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:25:47.197 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:25:47.274 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=51539607567 2026-02-17T08:25:47.275 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 51539607567 2026-02-17T08:25:47.275 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607567' 2026-02-17T08:25:47.275 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:25:47.275 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:25:47.352 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411341 2026-02-17T08:25:47.352 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411341 2026-02-17T08:25:47.352 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607567 2-77309411341' 2026-02-17T08:25:47.352 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:25:47.352 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:25:47.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=115964117003 2026-02-17T08:25:47.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 115964117003 2026-02-17T08:25:47.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607567 2-77309411341 3-115964117003' 2026-02-17T08:25:47.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:25:47.427 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:25:47.501 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=154618822666 2026-02-17T08:25:47.501 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 154618822666 2026-02-17T08:25:47.501 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607567 2-77309411341 3-115964117003 4-154618822666' 2026-02-17T08:25:47.501 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:25:47.502 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-17T08:25:47.576 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=188978561032 2026-02-17T08:25:47.576 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 188978561032 2026-02-17T08:25:47.576 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607567 2-77309411341 3-115964117003 4-154618822666 5-188978561032' 2026-02-17T08:25:47.576 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:25:47.577 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-17T08:25:47.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=223338299398 2026-02-17T08:25:47.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 223338299398 2026-02-17T08:25:47.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607567 2-77309411341 3-115964117003 4-154618822666 5-188978561032 6-223338299398' 2026-02-17T08:25:47.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:25:47.653 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803793 2026-02-17T08:25:47.653 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:25:47.654 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:25:47.655 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803793 2026-02-17T08:25:47.655 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:25:47.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803793 2026-02-17T08:25:47.657 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 25769803793 2026-02-17T08:25:47.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803793' 2026-02-17T08:25:47.657 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:25:47.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803791 -lt 25769803793 2026-02-17T08:25:47.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:25:48.856 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:25:48.857 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:25:49.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803793 -lt 25769803793 2026-02-17T08:25:49.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:25:49.051 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-51539607567 2026-02-17T08:25:49.051 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:25:49.053 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:25:49.053 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-51539607567 2026-02-17T08:25:49.054 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:25:49.055 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=51539607567 2026-02-17T08:25:49.055 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 51539607567 2026-02-17T08:25:49.056 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 51539607567' 2026-02-17T08:25:49.056 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:25:49.258 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 51539607567 -lt 51539607567 2026-02-17T08:25:49.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:25:49.259 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-77309411341 2026-02-17T08:25:49.259 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:25:49.260 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:25:49.261 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-77309411341 2026-02-17T08:25:49.261 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:25:49.263 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411341 2026-02-17T08:25:49.263 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 77309411341 2026-02-17T08:25:49.263 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 77309411341' 2026-02-17T08:25:49.263 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:25:49.461 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411341 -lt 77309411341 2026-02-17T08:25:49.461 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:25:49.462 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-115964117003 2026-02-17T08:25:49.462 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:25:49.463 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:25:49.464 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-115964117003 2026-02-17T08:25:49.464 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:25:49.466 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=115964117003 2026-02-17T08:25:49.466 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 115964117003' 2026-02-17T08:25:49.466 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 115964117003 2026-02-17T08:25:49.466 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:25:49.671 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 115964117003 -lt 115964117003 2026-02-17T08:25:49.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:25:49.672 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-154618822666 2026-02-17T08:25:49.672 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:25:49.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:25:49.674 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-154618822666 2026-02-17T08:25:49.675 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:25:49.676 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=154618822666 2026-02-17T08:25:49.676 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 154618822666' 2026-02-17T08:25:49.676 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.4 seq 154618822666 2026-02-17T08:25:49.676 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:25:49.884 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 154618822666 -lt 154618822666 2026-02-17T08:25:49.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:25:49.886 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 5-188978561032 2026-02-17T08:25:49.886 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:25:49.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=5 2026-02-17T08:25:49.887 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 5-188978561032 2026-02-17T08:25:49.887 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:25:49.888 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=188978561032 2026-02-17T08:25:49.888 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.5 seq 188978561032 2026-02-17T08:25:49.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.5 seq 188978561032' 2026-02-17T08:25:49.889 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T08:25:50.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 188978561032 -lt 188978561032 2026-02-17T08:25:50.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:25:50.097 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 6-223338299398 2026-02-17T08:25:50.097 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:25:50.099 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=6 2026-02-17T08:25:50.099 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 6-223338299398 2026-02-17T08:25:50.100 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:25:50.101 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=223338299398 2026-02-17T08:25:50.101 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.6 seq 223338299398 2026-02-17T08:25:50.101 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.6 seq 223338299398' 2026-02-17T08:25:50.101 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T08:25:50.303 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 223338299398 -lt 223338299398 2026-02-17T08:25:50.303 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:25:50.304 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:25:50.304 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:25:50.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:25:50.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:25:50.558 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:25:50.559 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:25:50.559 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:25:50.559 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:25:50.559 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:25:50.559 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:25:50.751 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:25:50.751 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:25:50.752 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:25:50.752 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:25:51.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:25:51.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:25:51.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:25:51.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:471: TEST_ec_recovery_multiple_objects: rados_get td/test-erasure-eio pool-jerasure test1 2026-02-17T08:25:51.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:25:51.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:25:51.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=test1 2026-02-17T08:25:51.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-17T08:25:51.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-17T08:25:51.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get test1 td/test-erasure-eio/COPY 2026-02-17T08:25:51.025 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-17T08:25:51.025 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-17T08:25:51.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:472: TEST_ec_recovery_multiple_objects: rados_get td/test-erasure-eio pool-jerasure test2 2026-02-17T08:25:51.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:25:51.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:25:51.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=test2 2026-02-17T08:25:51.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-17T08:25:51.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-17T08:25:51.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get test2 td/test-erasure-eio/COPY 2026-02-17T08:25:51.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-17T08:25:51.052 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-17T08:25:51.054 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:473: TEST_ec_recovery_multiple_objects: rados_get td/test-erasure-eio pool-jerasure test3 2026-02-17T08:25:51.054 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:25:51.054 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:25:51.054 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=test3 2026-02-17T08:25:51.054 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-17T08:25:51.054 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-17T08:25:51.054 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get test3 td/test-erasure-eio/COPY 2026-02-17T08:25:51.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-17T08:25:51.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-17T08:25:51.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:475: TEST_ec_recovery_multiple_objects: delete_erasure_coded_pool pool-jerasure 2026-02-17T08:25:51.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:25:51.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-17T08:25:51.321 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' does not exist 2026-02-17T08:25:51.330 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-17T08:25:51.592 INFO:tasks.workunit.client.0.trial059.stderr:erasure-code-profile myprofile does not exist 2026-02-17T08:25:51.601 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-17T08:25:51.601 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:25:51.601 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:25:51.601 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:25:51.601 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:25:51.601 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:25:51.602 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:25:51.602 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:25:51.602 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:25:51.714 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:25:51.714 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:25:51.715 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:25:51.716 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:25:51.717 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:25:51.717 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:25:51.718 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:25:51.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:25:51.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:25:51.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:25:51.720 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:25:51.721 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:25:51.722 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:25:51.722 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:25:51.745 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:25:51.745 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:25:51.745 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:25:51.745 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:25:51.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:25:51.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:25:51.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-17T08:25:51.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-17T08:25:51.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-eio 2026-02-17T08:25:51.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-eio 2026-02-17T08:25:51.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:25:51.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:25:51.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:25:51.749 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:25:51.749 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:25:51.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:25:51.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:25:51.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:25:51.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:25:51.751 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:25:51.751 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:25:51.752 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:25:51.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:25:51.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:25:51.754 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:25:51.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:25:51.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:25:51.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:25:51.756 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:25:51.757 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:25:51.758 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:25:51.758 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:25:51.759 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:25:51.760 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:25:51.760 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:25:51.760 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:25:51.761 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:25:51.761 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:25:51.761 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-eio 2026-02-17T08:25:51.762 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:25:51.762 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:25:51.762 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:25:51.763 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.70936 2026-02-17T08:25:51.765 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:25:51.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:25:51.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:25:51.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-17T08:25:51.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-17T08:25:51.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-eio 2026-02-17T08:25:51.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:25:51.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:25:51.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:25:51.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-eio/a 2026-02-17T08:25:51.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-17T08:25:51.787 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:25:51.787 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:25:51.787 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:25:51.787 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:25:51.787 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:25:51.787 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:25:51.788 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:25:51.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T08:25:51.815 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:25:51.817 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:25:51.817 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:25:51.817 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:25:51.817 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:25:51.817 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:25:51.818 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:25:51.818 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:25:51.819 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:25:51.819 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:25:51.819 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:25:51.819 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:25:51.819 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:25:51.819 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:25:51.819 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get fsid 2026-02-17T08:25:51.875 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:25:51.875 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:25:51.876 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:25:51.876 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:25:51.876 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:25:51.876 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:25:51.876 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:25:51.876 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:25:51.876 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:25:51.876 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:25:51.876 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:25:51.876 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:25:51.877 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:25:51.877 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get mon_host 2026-02-17T08:25:51.931 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-17T08:25:51.932 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-eio 2026-02-17T08:25:51.932 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:25:51.932 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:25:51.932 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:25:51.932 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-eio/x 2026-02-17T08:25:51.933 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:25:52.041 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:25:52.041 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:25:52.042 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:25:52.042 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:25:52.042 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:25:52.042 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:25:52.042 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:25:52.043 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:25:52.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:25:52.059 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-17T08:25:52.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T08:25:52.170 INFO:tasks.workunit.client.0.trial059.stderr:pool 'rbd' already exists 2026-02-17T08:25:52.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:25:53.180 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-17T08:25:53.181 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:25:53.181 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:25:53.181 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:25:53.181 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:25:53.181 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:25:53.181 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:25:53.182 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-17T08:25:53.182 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-mon.a.asok log flush 2026-02-17T08:25:53.229 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:25:53.235 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-17T08:25:53.237 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:25:51.792+0000 7f92c89d4ec0 0 load: jerasure load: lrc 2026-02-17T08:25:53.237 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_ec_recovery_multiple_objects_eio td/test-erasure-eio 2026-02-17T08:25:53.237 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:480: TEST_ec_recovery_multiple_objects_eio: local dir=td/test-erasure-eio 2026-02-17T08:25:53.237 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:481: TEST_ec_recovery_multiple_objects_eio: local objname=myobject 2026-02-17T08:25:53.237 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:483: TEST_ec_recovery_multiple_objects_eio: ORIG_ARGS='--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:25:53.237 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:484: TEST_ec_recovery_multiple_objects_eio: CEPH_ARGS+=' --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-17T08:25:53.237 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:485: TEST_ec_recovery_multiple_objects_eio: setup_osds 7 2026-02-17T08:25:53.237 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=7 2026-02-17T08:25:53.237 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-17T08:25:53.238 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 7 - 1 2026-02-17T08:25:53.239 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 6 2026-02-17T08:25:53.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:25:53.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-17T08:25:53.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:25:53.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:25:53.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:25:53.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:25:53.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-17T08:25:53.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-17T08:25:53.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:25:53.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:25:53.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:25:53.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-17T08:25:53.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-17T08:25:53.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:25:53.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:25:53.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:25:53.241 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:25:53.241 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:25:53.241 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:25:53.241 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:25:53.241 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:25:53.241 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:25:53.241 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:25:53.241 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:25:53.241 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:25:53.241 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:25:53.241 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:25:53.241 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:25:53.241 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:25:53.242 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:25:53.242 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:25:53.242 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:25:53.242 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:25:53.242 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:25:53.242 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:25:53.242 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-17T08:25:53.243 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:25:53.244 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=71a99739-b01d-4138-aa52-7d2ebe3f1334 2026-02-17T08:25:53.244 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 71a99739-b01d-4138-aa52-7d2ebe3f1334 2026-02-17T08:25:53.244 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 71a99739-b01d-4138-aa52-7d2ebe3f1334' 2026-02-17T08:25:53.244 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:25:53.256 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQARJpRpfZ+zDhAAB/tqMcz001j4n5+sCdKJZQ== 2026-02-17T08:25:53.257 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQARJpRpfZ+zDhAAB/tqMcz001j4n5+sCdKJZQ=="}' 2026-02-17T08:25:53.257 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 71a99739-b01d-4138-aa52-7d2ebe3f1334 -i td/test-erasure-eio/0/new.json 2026-02-17T08:25:53.370 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:25:53.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-17T08:25:53.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQARJpRpfZ+zDhAAB/tqMcz001j4n5+sCdKJZQ== --osd-uuid 71a99739-b01d-4138-aa52-7d2ebe3f1334 2026-02-17T08:25:53.398 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:53.383+0000 7ff8deee08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:53.399 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:53.387+0000 7ff8deee08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:53.400 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:53.387+0000 7ff8deee08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:53.401 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:53.387+0000 7ff8deee08c0 -1 bdev(0x563f4bc31c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:25:53.401 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:53.387+0000 7ff8deee08c0 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-17T08:25:55.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-17T08:25:55.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:25:55.949 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:25:55.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:25:55.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:25:56.216 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:25:56.216 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:25:56.216 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:25:56.216 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:25:56.216 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:25:56.216 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:25:56.241 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:56.227+0000 7fbe9283f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:56.242 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:56.227+0000 7fbe9283f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:56.243 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:56.231+0000 7fbe9283f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:25:56.421 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:25:56.421 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:25:56.421 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:25:56.421 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:25:56.422 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:25:56.422 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:25:56.422 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:56.422 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:25:56.423 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:56.423 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:25:56.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:57.623 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:57.623 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:57.624 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:25:57.625 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:25:57.625 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:57.625 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:25:57.729 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:25:57.715+0000 7fbe9283f8c0 -1 Falling back to public interface 2026-02-17T08:25:57.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:25:58.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:25:58.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:25:58.823 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:25:58.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:25:58.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:25:58.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:25:59.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:00.019 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:00.019 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:00.019 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:26:00.020 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:26:00.020 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:00.020 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:26:00.214 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:01.187 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:01.171+0000 7fbe9283f8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:26:01.216 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:01.216 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:01.216 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:26:01.216 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:26:01.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:01.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:26:01.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:02.419 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:02.419 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:02.419 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:26:02.420 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:26:02.420 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:02.420 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:26:02.614 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1542759207,v1:127.0.0.1:6803/1542759207] [v2:127.0.0.1:6804/1542759207,v1:127.0.0.1:6805/1542759207] exists,up 71a99739-b01d-4138-aa52-7d2ebe3f1334 2026-02-17T08:26:02.618 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:26:02.618 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:26:02.618 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:26:02.618 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:26:02.618 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-17T08:26:02.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:26:02.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:26:02.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T08:26:02.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:26:02.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-17T08:26:02.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-17T08:26:02.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:26:02.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:26:02.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:26:02.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-17T08:26:02.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-17T08:26:02.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:26:02.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:26:02.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:26:02.620 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:26:02.620 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:26:02.620 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:26:02.620 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:26:02.620 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:26:02.620 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:26:02.620 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:26:02.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:26:02.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:26:02.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:26:02.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:26:02.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:26:02.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:26:02.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:26:02.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:26:02.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:26:02.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:26:02.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:26:02.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:26:02.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-17T08:26:02.621 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:26:02.622 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=9458a1c6-de21-4a0d-bcec-ca83abf327d4 2026-02-17T08:26:02.622 INFO:tasks.workunit.client.0.trial059.stdout:add osd1 9458a1c6-de21-4a0d-bcec-ca83abf327d4 2026-02-17T08:26:02.623 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 9458a1c6-de21-4a0d-bcec-ca83abf327d4' 2026-02-17T08:26:02.623 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:26:02.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAaJpRp9Q4RJRAA07XVV5MiWrGb1VajUHqy5g== 2026-02-17T08:26:02.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAaJpRp9Q4RJRAA07XVV5MiWrGb1VajUHqy5g=="}' 2026-02-17T08:26:02.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 9458a1c6-de21-4a0d-bcec-ca83abf327d4 -i td/test-erasure-eio/1/new.json 2026-02-17T08:26:02.829 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:26:02.838 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-17T08:26:02.839 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAaJpRp9Q4RJRAA07XVV5MiWrGb1VajUHqy5g== --osd-uuid 9458a1c6-de21-4a0d-bcec-ca83abf327d4 2026-02-17T08:26:02.857 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:02.843+0000 7fc256d578c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:02.858 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:02.843+0000 7fc256d578c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:02.859 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:02.843+0000 7fc256d578c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:02.860 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:02.847+0000 7fc256d578c0 -1 bdev(0x563927265c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-17T08:26:02.860 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:02.847+0000 7fc256d578c0 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-17T08:26:05.156 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-17T08:26:05.156 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:26:05.157 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T08:26:05.157 INFO:tasks.workunit.client.0.trial059.stdout:adding osd1 key to auth repository 2026-02-17T08:26:05.157 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:26:05.426 INFO:tasks.workunit.client.0.trial059.stdout:start osd.1 2026-02-17T08:26:05.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T08:26:05.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:26:05.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:26:05.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:26:05.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:26:05.453 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:05.439+0000 7fa46e8028c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:05.455 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:05.439+0000 7fa46e8028c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:05.456 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:05.443+0000 7fa46e8028c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:05.626 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T08:26:05.626 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:26:05.626 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:26:05.626 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:26:05.626 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:26:05.627 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:05.627 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:26:05.627 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:26:05.628 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:05.628 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:26:05.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:06.824 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:06.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:06.825 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:26:06.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:26:06.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:06.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:26:06.985 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:06.971+0000 7fa46e8028c0 -1 Falling back to public interface 2026-02-17T08:26:07.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:08.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:08.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:08.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:26:08.024 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:26:08.024 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:08.024 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:26:08.222 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:09.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:09.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:09.224 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:26:09.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:26:09.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:09.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:26:09.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:10.034 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:10.019+0000 7fa46e8028c0 -1 osd.1 0 log_to_monitors true 2026-02-17T08:26:10.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:10.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:10.428 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:26:10.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:26:10.429 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:10.429 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:26:10.645 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:11.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:11.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:11.646 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:26:11.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:26:11.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:11.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:26:11.841 INFO:tasks.workunit.client.0.trial059.stdout:osd.1 up in weight 1 up_from 12 up_thru 12 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/990292217,v1:127.0.0.1:6811/990292217] [v2:127.0.0.1:6812/990292217,v1:127.0.0.1:6813/990292217] exists,up 9458a1c6-de21-4a0d-bcec-ca83abf327d4 2026-02-17T08:26:11.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:26:11.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:26:11.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:26:11.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:26:11.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-17T08:26:11.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:26:11.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:26:11.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T08:26:11.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:26:11.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-17T08:26:11.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-17T08:26:11.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:26:11.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:26:11.846 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:26:11.846 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-17T08:26:11.846 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-17T08:26:11.846 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:26:11.846 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:26:11.846 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:26:11.846 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:26:11.846 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:26:11.846 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:26:11.846 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:26:11.846 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:26:11.846 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:26:11.847 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:26:11.847 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:26:11.847 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:26:11.847 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:26:11.847 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:26:11.847 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:26:11.847 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:26:11.847 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:26:11.847 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:26:11.847 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:26:11.847 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:26:11.847 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:26:11.847 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:26:11.848 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-17T08:26:11.848 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:26:11.848 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=182f825e-932c-4b8b-aaa4-bd62f0bf25f8 2026-02-17T08:26:11.848 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 182f825e-932c-4b8b-aaa4-bd62f0bf25f8' 2026-02-17T08:26:11.849 INFO:tasks.workunit.client.0.trial059.stdout:add osd2 182f825e-932c-4b8b-aaa4-bd62f0bf25f8 2026-02-17T08:26:11.849 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:26:11.859 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAjJpRpv5GNMhAAAcq+3sGSCabCRSRAiHPlWw== 2026-02-17T08:26:11.859 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAjJpRpv5GNMhAAAcq+3sGSCabCRSRAiHPlWw=="}' 2026-02-17T08:26:11.859 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 182f825e-932c-4b8b-aaa4-bd62f0bf25f8 -i td/test-erasure-eio/2/new.json 2026-02-17T08:26:12.057 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:26:12.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-17T08:26:12.066 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAjJpRpv5GNMhAAAcq+3sGSCabCRSRAiHPlWw== --osd-uuid 182f825e-932c-4b8b-aaa4-bd62f0bf25f8 2026-02-17T08:26:12.083 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:12.067+0000 7f5ed0d488c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:12.084 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:12.071+0000 7f5ed0d488c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:12.085 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:12.071+0000 7f5ed0d488c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:12.086 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:12.071+0000 7f5ed0d488c0 -1 bdev(0x55d5f8623c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-17T08:26:12.086 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:12.071+0000 7f5ed0d488c0 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-17T08:26:14.386 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-17T08:26:14.386 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:26:14.387 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T08:26:14.387 INFO:tasks.workunit.client.0.trial059.stdout:adding osd2 key to auth repository 2026-02-17T08:26:14.387 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:26:14.653 INFO:tasks.workunit.client.0.trial059.stdout:start osd.2 2026-02-17T08:26:14.654 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T08:26:14.654 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:26:14.654 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:26:14.654 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:26:14.654 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:26:14.679 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:14.663+0000 7fa2a52128c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:14.680 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:14.667+0000 7fa2a52128c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:14.682 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:14.667+0000 7fa2a52128c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:14.852 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T08:26:14.852 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:26:14.853 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:26:14.853 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:26:14.853 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:26:14.853 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:14.853 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:26:14.854 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:26:14.854 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:14.854 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:26:15.056 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:16.057 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:16.057 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:16.057 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:26:16.057 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:26:16.057 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:16.057 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:26:16.169 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:16.155+0000 7fa2a52128c0 -1 Falling back to public interface 2026-02-17T08:26:16.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:17.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:17.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:17.253 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:26:17.253 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:26:17.253 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:17.253 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:26:17.447 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:18.448 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:18.448 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:18.449 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:26:18.449 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:26:18.449 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:18.449 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:26:18.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:19.420 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:19.407+0000 7fa2a52128c0 -1 osd.2 0 log_to_monitors true 2026-02-17T08:26:19.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:19.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:19.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:26:19.648 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:26:19.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:19.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:26:19.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:20.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:20.845 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:20.845 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:26:20.846 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:26:20.846 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:20.846 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:26:21.042 INFO:tasks.workunit.client.0.trial059.stdout:osd.2 up in weight 1 up_from 18 up_thru 20 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/4036543258,v1:127.0.0.1:6819/4036543258] [v2:127.0.0.1:6820/4036543258,v1:127.0.0.1:6821/4036543258] exists,up 182f825e-932c-4b8b-aaa4-bd62f0bf25f8 2026-02-17T08:26:21.045 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:26:21.045 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:26:21.045 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:26:21.045 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:26:21.045 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-17T08:26:21.045 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:26:21.045 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:26:21.045 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2026-02-17T08:26:21.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:26:21.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-17T08:26:21.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-17T08:26:21.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:26:21.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:26:21.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:26:21.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-17T08:26:21.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-17T08:26:21.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:26:21.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:26:21.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:26:21.046 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:26:21.047 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:26:21.047 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:26:21.047 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:26:21.047 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:26:21.047 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:26:21.047 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:26:21.047 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:26:21.047 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:26:21.047 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:26:21.047 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:26:21.047 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:26:21.047 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:26:21.047 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:26:21.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:26:21.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:26:21.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:26:21.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:26:21.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:26:21.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-17T08:26:21.049 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:26:21.049 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=43844701-cc58-4976-9543-7b26bac78bf1 2026-02-17T08:26:21.049 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 43844701-cc58-4976-9543-7b26bac78bf1' 2026-02-17T08:26:21.049 INFO:tasks.workunit.client.0.trial059.stdout:add osd3 43844701-cc58-4976-9543-7b26bac78bf1 2026-02-17T08:26:21.050 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:26:21.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAtJpRpcRrsAhAAYWK4VsWUcaOnCAhIXkW++A== 2026-02-17T08:26:21.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAtJpRpcRrsAhAAYWK4VsWUcaOnCAhIXkW++A=="}' 2026-02-17T08:26:21.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 43844701-cc58-4976-9543-7b26bac78bf1 -i td/test-erasure-eio/3/new.json 2026-02-17T08:26:21.256 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:26:21.264 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-17T08:26:21.265 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAtJpRpcRrsAhAAYWK4VsWUcaOnCAhIXkW++A== --osd-uuid 43844701-cc58-4976-9543-7b26bac78bf1 2026-02-17T08:26:21.283 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:21.267+0000 7f36590be8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:21.284 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:21.271+0000 7f36590be8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:21.285 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:21.271+0000 7f36590be8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:21.286 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:21.271+0000 7f36590be8c0 -1 bdev(0x559035ab1c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-17T08:26:21.286 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:21.271+0000 7f36590be8c0 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-17T08:26:23.569 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-17T08:26:23.569 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:26:23.570 INFO:tasks.workunit.client.0.trial059.stdout:adding osd3 key to auth repository 2026-02-17T08:26:23.570 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2026-02-17T08:26:23.570 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:26:23.835 INFO:tasks.workunit.client.0.trial059.stdout:start osd.3 2026-02-17T08:26:23.836 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2026-02-17T08:26:23.836 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:26:23.836 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:26:23.836 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:26:23.836 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:26:23.860 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:23.847+0000 7fcd6e68c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:23.862 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:23.847+0000 7fcd6e68c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:23.863 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:23.847+0000 7fcd6e68c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:24.035 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2026-02-17T08:26:24.035 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:26:24.035 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T08:26:24.035 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:26:24.035 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:26:24.035 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:26:24.035 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:24.035 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:26:24.035 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:24.035 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:26:24.230 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:25.231 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:25.231 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:25.231 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:26:25.231 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:26:25.231 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:25.231 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:26:25.374 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:25.358+0000 7fcd6e68c8c0 -1 Falling back to public interface 2026-02-17T08:26:25.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:26.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:26.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:26.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:26:26.433 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:26:26.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:26.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:26:26.629 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:27.631 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:27.631 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:27.631 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:26:27.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:26:27.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:27.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:26:27.828 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:28.651 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:28.634+0000 7fcd6e68c8c0 -1 osd.3 0 log_to_monitors true 2026-02-17T08:26:28.829 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:28.829 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:28.829 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:26:28.829 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:26:28.829 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:28.829 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:26:29.029 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:30.030 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:30.030 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:30.031 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:26:30.031 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:26:30.031 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:30.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:26:30.223 INFO:tasks.workunit.client.0.trial059.stdout:osd.3 up in weight 1 up_from 27 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3299456381,v1:127.0.0.1:6827/3299456381] [v2:127.0.0.1:6828/3299456381,v1:127.0.0.1:6829/3299456381] exists,up 43844701-cc58-4976-9543-7b26bac78bf1 2026-02-17T08:26:30.226 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:26:30.226 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:26:30.226 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:26:30.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:26:30.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 4 2026-02-17T08:26:30.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:26:30.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:26:30.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2026-02-17T08:26:30.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:26:30.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/4 2026-02-17T08:26:30.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-17T08:26:30.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:26:30.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:26:30.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:26:30.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/4' 2026-02-17T08:26:30.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/4/journal' 2026-02-17T08:26:30.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:26:30.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:26:30.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:26:30.228 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:26:30.228 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:26:30.228 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:26:30.228 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:26:30.228 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:26:30.228 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:26:30.228 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:26:30.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:26:30.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:26:30.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:26:30.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:26:30.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:26:30.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:26:30.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:26:30.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:26:30.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:26:30.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:26:30.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:26:30.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:26:30.230 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/4 2026-02-17T08:26:30.230 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:26:30.230 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=e65881a8-fe42-4337-bf95-0418e05834bb 2026-02-17T08:26:30.231 INFO:tasks.workunit.client.0.trial059.stdout:add osd4 e65881a8-fe42-4337-bf95-0418e05834bb 2026-02-17T08:26:30.231 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 e65881a8-fe42-4337-bf95-0418e05834bb' 2026-02-17T08:26:30.231 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:26:30.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQA2JpRp3vqrDRAAewuVyB6D2vEkQmY0XCbkdA== 2026-02-17T08:26:30.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQA2JpRp3vqrDRAAewuVyB6D2vEkQmY0XCbkdA=="}' 2026-02-17T08:26:30.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new e65881a8-fe42-4337-bf95-0418e05834bb -i td/test-erasure-eio/4/new.json 2026-02-17T08:26:30.444 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:26:30.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/4/new.json 2026-02-17T08:26:30.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA2JpRp3vqrDRAAewuVyB6D2vEkQmY0XCbkdA== --osd-uuid e65881a8-fe42-4337-bf95-0418e05834bb 2026-02-17T08:26:30.471 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:30.454+0000 7f7215f498c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:30.472 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:30.458+0000 7f7215f498c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:30.473 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:30.458+0000 7f7215f498c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:30.474 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:30.458+0000 7f7215f498c0 -1 bdev(0x55d7d8687c00 td/test-erasure-eio/4/block) open stat got: (1) Operation not permitted 2026-02-17T08:26:30.474 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:30.458+0000 7f7215f498c0 -1 bluestore(td/test-erasure-eio/4) _read_fsid unparsable uuid 2026-02-17T08:26:32.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/4/keyring 2026-02-17T08:26:32.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:26:32.745 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2026-02-17T08:26:32.745 INFO:tasks.workunit.client.0.trial059.stdout:adding osd4 key to auth repository 2026-02-17T08:26:32.745 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:26:33.013 INFO:tasks.workunit.client.0.trial059.stdout:start osd.4 2026-02-17T08:26:33.013 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2026-02-17T08:26:33.013 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:26:33.013 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:26:33.014 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:26:33.014 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:26:33.038 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:33.022+0000 7fc41a4408c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:33.039 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:33.022+0000 7fc41a4408c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:33.041 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:33.026+0000 7fc41a4408c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:33.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2026-02-17T08:26:33.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:26:33.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2026-02-17T08:26:33.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:26:33.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:26:33.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:33.217 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:26:33.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:26:33.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:33.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:26:33.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:34.412 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:34.412 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:34.413 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:26:34.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:26:34.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:34.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:26:34.530 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:34.514+0000 7fc41a4408c0 -1 Falling back to public interface 2026-02-17T08:26:34.607 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:35.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:35.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:35.609 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:26:35.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:26:35.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:35.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:26:35.803 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:36.805 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:36.805 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:36.805 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:26:36.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:26:36.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:36.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:26:36.998 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:37.734 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:37.718+0000 7fc41a4408c0 -1 osd.4 0 log_to_monitors true 2026-02-17T08:26:38.000 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:38.000 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:38.000 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:26:38.001 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:26:38.001 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:38.001 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:26:38.198 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:39.200 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:39.200 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:39.200 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:26:39.201 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:26:39.201 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:39.201 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:26:39.396 INFO:tasks.workunit.client.0.trial059.stdout:osd.4 up in weight 1 up_from 35 up_thru 36 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/2096331990,v1:127.0.0.1:6835/2096331990] [v2:127.0.0.1:6836/2096331990,v1:127.0.0.1:6837/2096331990] exists,up e65881a8-fe42-4337-bf95-0418e05834bb 2026-02-17T08:26:39.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:26:39.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:26:39.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:26:39.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:26:39.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 5 2026-02-17T08:26:39.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:26:39.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:26:39.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=5 2026-02-17T08:26:39.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:26:39.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/5 2026-02-17T08:26:39.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-17T08:26:39.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:26:39.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:26:39.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:26:39.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/5' 2026-02-17T08:26:39.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/5/journal' 2026-02-17T08:26:39.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:26:39.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:26:39.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:26:39.402 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:26:39.402 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:26:39.402 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:26:39.402 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:26:39.402 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:26:39.402 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:26:39.402 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:26:39.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:26:39.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:26:39.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:26:39.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:26:39.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:26:39.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:26:39.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:26:39.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:26:39.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:26:39.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:26:39.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:26:39.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:26:39.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/5 2026-02-17T08:26:39.403 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:26:39.404 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=83765ed8-d8e7-47b5-8da7-3a9e50783133 2026-02-17T08:26:39.404 INFO:tasks.workunit.client.0.trial059.stdout:add osd5 83765ed8-d8e7-47b5-8da7-3a9e50783133 2026-02-17T08:26:39.405 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd5 83765ed8-d8e7-47b5-8da7-3a9e50783133' 2026-02-17T08:26:39.405 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:26:39.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQA/JpRp/E/3FxAA99WR11P7+/iEnhzLOfZuaQ== 2026-02-17T08:26:39.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQA/JpRp/E/3FxAA99WR11P7+/iEnhzLOfZuaQ=="}' 2026-02-17T08:26:39.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 83765ed8-d8e7-47b5-8da7-3a9e50783133 -i td/test-erasure-eio/5/new.json 2026-02-17T08:26:39.612 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:26:39.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/5/new.json 2026-02-17T08:26:39.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 5 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA/JpRp/E/3FxAA99WR11P7+/iEnhzLOfZuaQ== --osd-uuid 83765ed8-d8e7-47b5-8da7-3a9e50783133 2026-02-17T08:26:39.639 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:39.622+0000 7fe9ce6388c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:39.640 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:39.622+0000 7fe9ce6388c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:39.641 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:39.626+0000 7fe9ce6388c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:39.642 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:39.626+0000 7fe9ce6388c0 -1 bdev(0x564f6f005c00 td/test-erasure-eio/5/block) open stat got: (1) Operation not permitted 2026-02-17T08:26:39.642 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:39.626+0000 7fe9ce6388c0 -1 bluestore(td/test-erasure-eio/5) _read_fsid unparsable uuid 2026-02-17T08:26:41.941 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/5/keyring 2026-02-17T08:26:41.941 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:26:41.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd5 key to auth repository 2026-02-17T08:26:41.942 INFO:tasks.workunit.client.0.trial059.stdout:adding osd5 key to auth repository 2026-02-17T08:26:41.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:26:42.213 INFO:tasks.workunit.client.0.trial059.stdout:start osd.5 2026-02-17T08:26:42.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.5 2026-02-17T08:26:42.214 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 5 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:26:42.214 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:26:42.214 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:26:42.214 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:26:42.238 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:42.222+0000 7f193f3e38c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:42.240 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:42.222+0000 7f193f3e38c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:42.241 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:42.226+0000 7f193f3e38c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:42.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 5 2026-02-17T08:26:42.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:26:42.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=5 2026-02-17T08:26:42.418 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:26:42.418 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:26:42.418 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:42.418 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:26:42.419 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:26:42.419 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:42.419 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:26:42.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:43.617 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:43.618 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:43.618 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:26:43.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:26:43.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:43.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:26:43.738 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:43.722+0000 7f193f3e38c0 -1 Falling back to public interface 2026-02-17T08:26:43.812 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:44.813 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:44.813 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:44.814 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:26:44.814 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:26:44.814 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:44.815 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:26:45.009 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:46.011 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:46.011 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:46.011 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:26:46.011 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:26:46.011 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:46.011 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:26:46.205 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:46.730 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:46.714+0000 7f193f3e38c0 -1 osd.5 0 log_to_monitors true 2026-02-17T08:26:47.206 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:47.206 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:47.207 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:26:47.207 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:26:47.207 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:47.207 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:26:47.410 INFO:tasks.workunit.client.0.trial059.stdout:osd.5 up in weight 1 up_from 44 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/1079807206,v1:127.0.0.1:6843/1079807206] [v2:127.0.0.1:6844/1079807206,v1:127.0.0.1:6845/1079807206] exists,up 83765ed8-d8e7-47b5-8da7-3a9e50783133 2026-02-17T08:26:47.412 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:26:47.412 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:26:47.412 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:26:47.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:26:47.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 6 2026-02-17T08:26:47.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:26:47.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:26:47.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=6 2026-02-17T08:26:47.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:26:47.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/6 2026-02-17T08:26:47.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-17T08:26:47.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:26:47.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:26:47.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:26:47.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/6' 2026-02-17T08:26:47.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/6/journal' 2026-02-17T08:26:47.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:26:47.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:26:47.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:26:47.414 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:26:47.414 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:26:47.414 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:26:47.414 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:26:47.414 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:26:47.414 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:26:47.414 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:26:47.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:26:47.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:26:47.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:26:47.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:26:47.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:26:47.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:26:47.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:26:47.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:26:47.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:26:47.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:26:47.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:26:47.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:26:47.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/6 2026-02-17T08:26:47.415 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:26:47.416 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=9ce61c32-0447-4830-8d39-ee18c66a700d 2026-02-17T08:26:47.416 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd6 9ce61c32-0447-4830-8d39-ee18c66a700d' 2026-02-17T08:26:47.416 INFO:tasks.workunit.client.0.trial059.stdout:add osd6 9ce61c32-0447-4830-8d39-ee18c66a700d 2026-02-17T08:26:47.416 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:26:47.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBHJpRpg8nJGBAAdiwXBuJ47v9PC9vHmqhCAQ== 2026-02-17T08:26:47.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBHJpRpg8nJGBAAdiwXBuJ47v9PC9vHmqhCAQ=="}' 2026-02-17T08:26:47.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 9ce61c32-0447-4830-8d39-ee18c66a700d -i td/test-erasure-eio/6/new.json 2026-02-17T08:26:47.643 INFO:tasks.workunit.client.0.trial059.stdout:6 2026-02-17T08:26:47.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/6/new.json 2026-02-17T08:26:47.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 6 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBHJpRpg8nJGBAAdiwXBuJ47v9PC9vHmqhCAQ== --osd-uuid 9ce61c32-0447-4830-8d39-ee18c66a700d 2026-02-17T08:26:47.679 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:47.662+0000 7ff05fd5e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:47.681 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:47.666+0000 7ff05fd5e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:47.682 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:47.666+0000 7ff05fd5e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:47.683 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:47.666+0000 7ff05fd5e8c0 -1 bdev(0x55d1677b5c00 td/test-erasure-eio/6/block) open stat got: (1) Operation not permitted 2026-02-17T08:26:47.683 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:47.666+0000 7ff05fd5e8c0 -1 bluestore(td/test-erasure-eio/6) _read_fsid unparsable uuid 2026-02-17T08:26:49.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/6/keyring 2026-02-17T08:26:49.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:26:49.943 INFO:tasks.workunit.client.0.trial059.stdout:adding osd6 key to auth repository 2026-02-17T08:26:49.943 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd6 key to auth repository 2026-02-17T08:26:49.943 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:26:50.212 INFO:tasks.workunit.client.0.trial059.stdout:start osd.6 2026-02-17T08:26:50.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.6 2026-02-17T08:26:50.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 6 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:26:50.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:26:50.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:26:50.214 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:26:50.229 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:50.218+0000 7f81fecb58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:50.230 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:50.218+0000 7f81fecb58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:50.231 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:50.218+0000 7f81fecb58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:26:50.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 6 2026-02-17T08:26:50.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:26:50.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=6 2026-02-17T08:26:50.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:26:50.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:26:50.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:50.410 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:26:50.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:26:50.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:50.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:26:50.612 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:51.614 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:51.614 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:51.614 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:26:51.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:26:51.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:51.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:26:51.813 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:51.999 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:51.986+0000 7f81fecb58c0 -1 Falling back to public interface 2026-02-17T08:26:52.814 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:52.814 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:52.815 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:26:52.815 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:26:52.816 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:52.816 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:26:53.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:54.016 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:54.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:54.017 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:26:54.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:26:54.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:54.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:26:54.219 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:54.993 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:26:54.978+0000 7f81fecb58c0 -1 osd.6 0 log_to_monitors true 2026-02-17T08:26:55.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:55.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:55.220 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:26:55.221 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:26:55.221 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:55.221 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:26:55.416 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:26:56.418 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:26:56.418 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:26:56.418 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:26:56.419 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:26:56.419 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:26:56.419 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:26:56.617 INFO:tasks.workunit.client.0.trial059.stdout:osd.6 up in weight 1 up_from 53 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/4060523153,v1:127.0.0.1:6851/4060523153] [v2:127.0.0.1:6852/4060523153,v1:127.0.0.1:6853/4060523153] exists,up 9ce61c32-0447-4830-8d39-ee18c66a700d 2026-02-17T08:26:56.618 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:26:56.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:26:56.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:26:56.619 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-17T08:26:56.619 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:26:56.619 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:26:56.620 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:26:56.620 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:26:56.620 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:26:56.620 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.0.asok 2026-02-17T08:26:56.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-17T08:26:56.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.0.asok log flush 2026-02-17T08:26:56.681 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:26:56.687 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-17T08:26:56.689 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:25:57.719+0000 7fbe9283f8c0 0 load: jerasure load: lrc 2026-02-17T08:26:56.690 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:486: TEST_ec_recovery_multiple_objects_eio: CEPH_ARGS='--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:26:56.691 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:488: TEST_ec_recovery_multiple_objects_eio: local poolname=pool-jerasure 2026-02-17T08:26:56.691 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:489: TEST_ec_recovery_multiple_objects_eio: create_erasure_coded_pool pool-jerasure 3 2 2026-02-17T08:26:56.691 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:26:56.691 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-17T08:26:56.691 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=3 2026-02-17T08:26:56.691 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-17T08:26:56.691 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=2 2026-02-17T08:26:56.691 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-17T08:26:56.691 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=3 m=2 crush-failure-domain=osd 2026-02-17T08:26:56.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-17T08:26:56.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-17T08:26:57.344 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' already exists 2026-02-17T08:26:57.353 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:26:58.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-17T08:26:58.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:26:58.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:26:58.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:26:58.355 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:26:58.356 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:26:58.356 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:26:58.356 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:26:58.356 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:26:58.356 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:26:58.465 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:26:58.465 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:26:58.465 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:26:58.465 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:26:58.465 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:26:58.465 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:26:58.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:26:58.668 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:26:58.668 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:26:58.668 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:26:58.668 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:26:58.668 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:26:58.668 INFO:tasks.workunit.client.0.trial059.stderr:6' 2026-02-17T08:26:58.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:26:58.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:26:58.668 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:26:58.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803790 2026-02-17T08:26:58.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803790 2026-02-17T08:26:58.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803790' 2026-02-17T08:26:58.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:26:58.743 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:26:58.820 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=51539607564 2026-02-17T08:26:58.820 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 51539607564 2026-02-17T08:26:58.820 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803790 1-51539607564' 2026-02-17T08:26:58.820 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:26:58.820 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:26:58.894 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411338 2026-02-17T08:26:58.894 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411338 2026-02-17T08:26:58.894 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803790 1-51539607564 2-77309411338' 2026-02-17T08:26:58.895 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:26:58.895 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:26:58.971 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=115964117000 2026-02-17T08:26:58.971 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 115964117000 2026-02-17T08:26:58.971 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803790 1-51539607564 2-77309411338 3-115964117000' 2026-02-17T08:26:58.971 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:26:58.971 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:26:59.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=150323855367 2026-02-17T08:26:59.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 150323855367 2026-02-17T08:26:59.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803790 1-51539607564 2-77309411338 3-115964117000 4-150323855367' 2026-02-17T08:26:59.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:26:59.046 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-17T08:26:59.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=188978561029 2026-02-17T08:26:59.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 188978561029 2026-02-17T08:26:59.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803790 1-51539607564 2-77309411338 3-115964117000 4-150323855367 5-188978561029' 2026-02-17T08:26:59.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:26:59.123 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-17T08:26:59.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=227633266691 2026-02-17T08:26:59.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 227633266691 2026-02-17T08:26:59.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803790 1-51539607564 2-77309411338 3-115964117000 4-150323855367 5-188978561029 6-227633266691' 2026-02-17T08:26:59.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:26:59.200 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803790 2026-02-17T08:26:59.200 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:26:59.200 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:26:59.201 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803790 2026-02-17T08:26:59.201 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:26:59.203 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803790 2026-02-17T08:26:59.203 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803790' 2026-02-17T08:26:59.203 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 25769803790 2026-02-17T08:26:59.204 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:26:59.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803788 -lt 25769803790 2026-02-17T08:26:59.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:27:00.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:27:00.404 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:27:00.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803790 -lt 25769803790 2026-02-17T08:27:00.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:27:00.609 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-51539607564 2026-02-17T08:27:00.610 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:27:00.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:27:00.611 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-51539607564 2026-02-17T08:27:00.611 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:27:00.612 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=51539607564 2026-02-17T08:27:00.612 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 51539607564' 2026-02-17T08:27:00.612 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 51539607564 2026-02-17T08:27:00.613 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:27:00.815 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 51539607564 -lt 51539607564 2026-02-17T08:27:00.815 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:27:00.815 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-77309411338 2026-02-17T08:27:00.816 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:27:00.817 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:27:00.817 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-77309411338 2026-02-17T08:27:00.817 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:27:00.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411338 2026-02-17T08:27:00.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 77309411338' 2026-02-17T08:27:00.819 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 77309411338 2026-02-17T08:27:00.820 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:27:01.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411338 -lt 77309411338 2026-02-17T08:27:01.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:27:01.015 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-115964117000 2026-02-17T08:27:01.016 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:27:01.016 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:27:01.017 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-115964117000 2026-02-17T08:27:01.017 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:27:01.019 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=115964117000 2026-02-17T08:27:01.019 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 115964117000' 2026-02-17T08:27:01.019 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 115964117000 2026-02-17T08:27:01.019 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:27:01.221 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 115964117001 -lt 115964117000 2026-02-17T08:27:01.221 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:27:01.222 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-150323855367 2026-02-17T08:27:01.222 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:27:01.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:27:01.224 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-150323855367 2026-02-17T08:27:01.224 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:27:01.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=150323855367 2026-02-17T08:27:01.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 150323855367' 2026-02-17T08:27:01.226 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.4 seq 150323855367 2026-02-17T08:27:01.226 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:27:01.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 150323855367 -lt 150323855367 2026-02-17T08:27:01.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:27:01.427 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 5-188978561029 2026-02-17T08:27:01.427 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:27:01.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=5 2026-02-17T08:27:01.428 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 5-188978561029 2026-02-17T08:27:01.429 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:27:01.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=188978561029 2026-02-17T08:27:01.430 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.5 seq 188978561029 2026-02-17T08:27:01.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.5 seq 188978561029' 2026-02-17T08:27:01.431 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T08:27:01.625 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 188978561029 -lt 188978561029 2026-02-17T08:27:01.625 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:27:01.625 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 6-227633266691 2026-02-17T08:27:01.626 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:27:01.626 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=6 2026-02-17T08:27:01.627 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 6-227633266691 2026-02-17T08:27:01.627 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:27:01.629 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=227633266691 2026-02-17T08:27:01.629 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.6 seq 227633266691 2026-02-17T08:27:01.629 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.6 seq 227633266691' 2026-02-17T08:27:01.630 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T08:27:01.839 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 227633266691 -lt 227633266691 2026-02-17T08:27:01.840 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:27:01.840 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:27:01.840 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:27:02.102 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:27:02.102 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:27:02.103 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:27:02.104 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:27:02.104 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:27:02.104 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:27:02.104 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:27:02.104 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:27:02.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:27:02.298 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:27:02.299 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:27:02.299 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:27:02.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:27:02.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:27:02.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:27:02.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:491: TEST_ec_recovery_multiple_objects_eio: rados_put td/test-erasure-eio pool-jerasure test1 2026-02-17T08:27:02.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-17T08:27:02.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-17T08:27:02.560 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=test1 2026-02-17T08:27:02.560 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:27:02.560 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-17T08:27:02.560 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:27:02.560 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-17T08:27:02.560 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:27:02.560 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-17T08:27:02.560 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:27:02.560 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-17T08:27:02.560 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put test1 td/test-erasure-eio/ORIGINAL 2026-02-17T08:27:02.578 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:492: TEST_ec_recovery_multiple_objects_eio: rados_put td/test-erasure-eio pool-jerasure test2 2026-02-17T08:27:02.578 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-17T08:27:02.578 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-17T08:27:02.578 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=test2 2026-02-17T08:27:02.578 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:27:02.578 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-17T08:27:02.578 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:27:02.578 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-17T08:27:02.579 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:27:02.579 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-17T08:27:02.579 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:27:02.579 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-17T08:27:02.579 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put test2 td/test-erasure-eio/ORIGINAL 2026-02-17T08:27:02.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:493: TEST_ec_recovery_multiple_objects_eio: rados_put td/test-erasure-eio pool-jerasure test3 2026-02-17T08:27:02.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-17T08:27:02.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-17T08:27:02.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=test3 2026-02-17T08:27:02.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:27:02.599 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-17T08:27:02.599 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:27:02.599 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-17T08:27:02.599 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:27:02.599 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-17T08:27:02.599 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:27:02.599 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-17T08:27:02.599 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put test3 td/test-erasure-eio/ORIGINAL 2026-02-17T08:27:02.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:496: TEST_ec_recovery_multiple_objects_eio: inject_eio ec data pool-jerasure myobject td/test-erasure-eio 0 2026-02-17T08:27:02.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2457: inject_eio: local pooltype=ec 2026-02-17T08:27:02.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2458: inject_eio: shift 2026-02-17T08:27:02.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2459: inject_eio: local which=data 2026-02-17T08:27:02.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2460: inject_eio: shift 2026-02-17T08:27:02.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2461: inject_eio: local poolname=pool-jerasure 2026-02-17T08:27:02.622 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2462: inject_eio: shift 2026-02-17T08:27:02.622 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2463: inject_eio: local objname=myobject 2026-02-17T08:27:02.622 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2464: inject_eio: shift 2026-02-17T08:27:02.622 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2465: inject_eio: local dir=td/test-erasure-eio 2026-02-17T08:27:02.622 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2466: inject_eio: shift 2026-02-17T08:27:02.622 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2467: inject_eio: local shard_id=0 2026-02-17T08:27:02.622 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2468: inject_eio: shift 2026-02-17T08:27:02.622 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: get_osds pool-jerasure myobject 2026-02-17T08:27:02.622 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:27:02.622 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=myobject 2026-02-17T08:27:02.623 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-17T08:27:02.623 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:27:02.817 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:27:02.817 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:27:02.818 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:27:02.818 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:27:02.818 INFO:tasks.workunit.client.0.trial059.stderr:6' 2026-02-17T08:27:02.818 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 5 1 0 6 2026-02-17T08:27:02.818 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: initial_osds=('3' '5' '1' '0' '6') 2026-02-17T08:27:02.818 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: local -a initial_osds 2026-02-17T08:27:02.818 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2471: inject_eio: local osd_id=3 2026-02-17T08:27:02.818 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2472: inject_eio: '[' ec '!=' ec ']' 2026-02-17T08:27:02.819 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: cat td/test-erasure-eio/3/type 2026-02-17T08:27:02.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: type=bluestore 2026-02-17T08:27:02.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2476: inject_eio: set_config osd 3 bluestore_debug_inject_read_err true 2026-02-17T08:27:02.820 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1161: set_config: local daemon=osd 2026-02-17T08:27:02.820 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1162: set_config: local id=3 2026-02-17T08:27:02.820 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1163: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T08:27:02.820 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1164: set_config: local value=true 2026-02-17T08:27:02.820 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: jq 'has("success")' 2026-02-17T08:27:02.821 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: get_asok_path osd.3 2026-02-17T08:27:02.821 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2026-02-17T08:27:02.821 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2026-02-17T08:27:02.821 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:27:02.821 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:27:02.822 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:27:02.822 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.3.asok 2026-02-17T08:27:02.822 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.70936/ceph-osd.3.asok config set bluestore_debug_inject_read_err true 2026-02-17T08:27:02.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: test true == true 2026-02-17T08:27:02.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2477: inject_eio: local loop=0 2026-02-17T08:27:02.882 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2479: inject_eio: grep -q Invalid 2026-02-17T08:27:02.882 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: get_asok_path osd.3 2026-02-17T08:27:02.883 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2026-02-17T08:27:02.883 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2026-02-17T08:27:02.884 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:27:02.884 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:27:02.884 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:27:02.884 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.3.asok 2026-02-17T08:27:02.884 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: CEPH_ARGS= 2026-02-17T08:27:02.884 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.3.asok injectdataerr pool-jerasure myobject 0 2026-02-17T08:27:02.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:497: TEST_ec_recovery_multiple_objects_eio: ceph osd out 0 2026-02-17T08:27:03.190 INFO:tasks.workunit.client.0.trial059.stderr:osd.0 is already out. 2026-02-17T08:27:03.200 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:500: TEST_ec_recovery_multiple_objects_eio: wait_for_clean 2026-02-17T08:27:03.200 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:27:03.200 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:27:03.200 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:27:03.201 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:27:03.201 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:27:03.201 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:27:03.202 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:27:03.202 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:27:03.202 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:27:03.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:27:03.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:27:03.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:27:03.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:27:03.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:27:03.314 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:27:03.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:27:03.514 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:27:03.514 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:27:03.514 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:27:03.514 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:27:03.514 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:27:03.514 INFO:tasks.workunit.client.0.trial059.stderr:6' 2026-02-17T08:27:03.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:27:03.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:27:03.515 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:27:03.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803793 2026-02-17T08:27:03.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803793 2026-02-17T08:27:03.591 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793' 2026-02-17T08:27:03.591 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:27:03.591 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:27:03.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=51539607567 2026-02-17T08:27:03.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 51539607567 2026-02-17T08:27:03.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607567' 2026-02-17T08:27:03.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:27:03.667 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:27:03.742 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411341 2026-02-17T08:27:03.742 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411341 2026-02-17T08:27:03.742 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607567 2-77309411341' 2026-02-17T08:27:03.742 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:27:03.742 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:27:03.818 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=115964117003 2026-02-17T08:27:03.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 115964117003 2026-02-17T08:27:03.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607567 2-77309411341 3-115964117003' 2026-02-17T08:27:03.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:27:03.819 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:27:03.894 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=150323855369 2026-02-17T08:27:03.894 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 150323855369 2026-02-17T08:27:03.894 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607567 2-77309411341 3-115964117003 4-150323855369' 2026-02-17T08:27:03.895 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:27:03.895 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-17T08:27:03.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=188978561032 2026-02-17T08:27:03.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 188978561032 2026-02-17T08:27:03.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607567 2-77309411341 3-115964117003 4-150323855369 5-188978561032' 2026-02-17T08:27:03.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:27:03.968 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-17T08:27:04.042 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=227633266694 2026-02-17T08:27:04.042 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 227633266694 2026-02-17T08:27:04.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607567 2-77309411341 3-115964117003 4-150323855369 5-188978561032 6-227633266694' 2026-02-17T08:27:04.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:27:04.043 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803793 2026-02-17T08:27:04.043 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:27:04.044 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:27:04.045 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803793 2026-02-17T08:27:04.045 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:27:04.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803793 2026-02-17T08:27:04.046 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 25769803793 2026-02-17T08:27:04.047 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803793' 2026-02-17T08:27:04.047 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:27:04.249 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803790 -lt 25769803793 2026-02-17T08:27:04.249 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:27:05.250 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:27:05.251 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:27:05.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803793 -lt 25769803793 2026-02-17T08:27:05.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:27:05.452 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-51539607567 2026-02-17T08:27:05.452 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:27:05.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:27:05.454 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-51539607567 2026-02-17T08:27:05.454 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:27:05.455 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=51539607567 2026-02-17T08:27:05.456 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 51539607567' 2026-02-17T08:27:05.456 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 51539607567 2026-02-17T08:27:05.456 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:27:05.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 51539607567 -lt 51539607567 2026-02-17T08:27:05.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:27:05.653 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-77309411341 2026-02-17T08:27:05.653 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:27:05.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:27:05.655 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-77309411341 2026-02-17T08:27:05.656 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:27:05.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411341 2026-02-17T08:27:05.657 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 77309411341 2026-02-17T08:27:05.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 77309411341' 2026-02-17T08:27:05.657 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:27:05.859 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411341 -lt 77309411341 2026-02-17T08:27:05.859 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:27:05.859 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-115964117003 2026-02-17T08:27:05.860 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:27:05.860 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:27:05.861 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-115964117003 2026-02-17T08:27:05.862 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:27:05.863 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=115964117003 2026-02-17T08:27:05.863 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 115964117003 2026-02-17T08:27:05.864 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 115964117003' 2026-02-17T08:27:05.864 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:27:06.067 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 115964117003 -lt 115964117003 2026-02-17T08:27:06.067 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:27:06.067 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-150323855369 2026-02-17T08:27:06.068 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:27:06.069 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:27:06.069 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-150323855369 2026-02-17T08:27:06.069 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:27:06.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=150323855369 2026-02-17T08:27:06.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 150323855369' 2026-02-17T08:27:06.071 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.4 seq 150323855369 2026-02-17T08:27:06.071 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:27:06.283 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 150323855370 -lt 150323855369 2026-02-17T08:27:06.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:27:06.284 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 5-188978561032 2026-02-17T08:27:06.284 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:27:06.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=5 2026-02-17T08:27:06.286 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 5-188978561032 2026-02-17T08:27:06.286 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:27:06.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=188978561032 2026-02-17T08:27:06.288 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.5 seq 188978561032 2026-02-17T08:27:06.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.5 seq 188978561032' 2026-02-17T08:27:06.289 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T08:27:06.494 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 188978561032 -lt 188978561032 2026-02-17T08:27:06.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:27:06.495 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 6-227633266694 2026-02-17T08:27:06.495 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:27:06.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=6 2026-02-17T08:27:06.497 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 6-227633266694 2026-02-17T08:27:06.498 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:27:06.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=227633266694 2026-02-17T08:27:06.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.6 seq 227633266694' 2026-02-17T08:27:06.499 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.6 seq 227633266694 2026-02-17T08:27:06.499 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T08:27:06.699 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 227633266695 -lt 227633266694 2026-02-17T08:27:06.700 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:27:06.700 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:27:06.701 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:27:06.958 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:27:06.958 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:27:06.958 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:27:06.958 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:27:06.958 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:27:06.958 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:27:06.959 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:27:06.959 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:27:07.154 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:27:07.155 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:27:07.156 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:27:07.156 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:27:07.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:27:07.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:27:07.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:27:07.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:502: TEST_ec_recovery_multiple_objects_eio: rados_get td/test-erasure-eio pool-jerasure test1 2026-02-17T08:27:07.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:27:07.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:27:07.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=test1 2026-02-17T08:27:07.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-17T08:27:07.418 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-17T08:27:07.418 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get test1 td/test-erasure-eio/COPY 2026-02-17T08:27:07.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-17T08:27:07.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-17T08:27:07.437 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:503: TEST_ec_recovery_multiple_objects_eio: rados_get td/test-erasure-eio pool-jerasure test2 2026-02-17T08:27:07.437 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:27:07.437 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:27:07.437 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=test2 2026-02-17T08:27:07.437 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-17T08:27:07.437 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-17T08:27:07.437 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get test2 td/test-erasure-eio/COPY 2026-02-17T08:27:07.461 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-17T08:27:07.462 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-17T08:27:07.464 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:504: TEST_ec_recovery_multiple_objects_eio: rados_get td/test-erasure-eio pool-jerasure test3 2026-02-17T08:27:07.464 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:27:07.464 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:27:07.464 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=test3 2026-02-17T08:27:07.464 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-17T08:27:07.464 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-17T08:27:07.464 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get test3 td/test-erasure-eio/COPY 2026-02-17T08:27:07.489 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-17T08:27:07.490 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-17T08:27:07.491 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:506: TEST_ec_recovery_multiple_objects_eio: delete_erasure_coded_pool pool-jerasure 2026-02-17T08:27:07.492 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:27:07.492 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-17T08:27:07.730 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' does not exist 2026-02-17T08:27:07.739 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-17T08:27:07.997 INFO:tasks.workunit.client.0.trial059.stderr:erasure-code-profile myprofile does not exist 2026-02-17T08:27:08.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-17T08:27:08.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:27:08.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:27:08.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:27:08.007 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:27:08.007 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:27:08.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:27:08.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:27:08.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:27:08.318 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:27:08.319 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:27:08.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:27:08.321 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:27:08.322 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:27:08.322 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:27:08.323 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:27:08.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:27:08.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:27:08.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:27:08.325 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:27:08.326 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:27:08.327 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:27:08.327 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:27:08.350 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:27:08.351 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:27:08.351 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:27:08.351 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:27:08.353 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:27:08.353 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:27:08.353 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-17T08:27:08.353 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-17T08:27:08.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-eio 2026-02-17T08:27:08.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-eio 2026-02-17T08:27:08.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:27:08.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:27:08.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:27:08.354 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:27:08.354 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:27:08.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:27:08.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:27:08.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:27:08.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:27:08.356 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:27:08.357 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:27:08.357 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:27:08.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:27:08.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:27:08.359 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:27:08.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:27:08.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:27:08.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:27:08.361 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:27:08.362 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:27:08.363 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:27:08.363 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:27:08.364 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:27:08.364 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:27:08.364 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:27:08.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:27:08.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:27:08.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:27:08.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-eio 2026-02-17T08:27:08.367 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:27:08.367 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:27:08.367 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:27:08.368 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.70936 2026-02-17T08:27:08.369 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:27:08.370 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:27:08.370 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:27:08.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-17T08:27:08.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-17T08:27:08.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-eio 2026-02-17T08:27:08.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:27:08.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:27:08.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:27:08.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-eio/a 2026-02-17T08:27:08.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-17T08:27:08.392 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:27:08.392 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:27:08.392 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:27:08.392 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:27:08.392 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:27:08.392 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:27:08.393 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:27:08.393 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T08:27:08.421 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:27:08.422 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:27:08.422 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:27:08.422 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:27:08.422 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:27:08.423 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:27:08.424 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:27:08.424 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:27:08.424 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:27:08.424 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:27:08.424 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:27:08.424 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:27:08.425 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:27:08.425 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:27:08.425 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get fsid 2026-02-17T08:27:08.479 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:27:08.479 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:27:08.479 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:27:08.480 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:27:08.480 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:27:08.481 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:27:08.481 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:27:08.481 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:27:08.481 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:27:08.481 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:27:08.482 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:27:08.482 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:27:08.482 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:27:08.482 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get mon_host 2026-02-17T08:27:08.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-17T08:27:08.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-eio 2026-02-17T08:27:08.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:27:08.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:27:08.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:27:08.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-eio/x 2026-02-17T08:27:08.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:27:08.642 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:27:08.642 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:27:08.642 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:27:08.642 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:27:08.642 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:27:08.642 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:27:08.643 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:27:08.643 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:27:08.644 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:27:08.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-17T08:27:08.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T08:27:08.767 INFO:tasks.workunit.client.0.trial059.stderr:pool 'rbd' already exists 2026-02-17T08:27:08.775 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:27:09.778 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-17T08:27:09.778 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:27:09.779 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:27:09.779 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:27:09.779 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:27:09.779 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:27:09.779 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:27:09.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-17T08:27:09.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-mon.a.asok log flush 2026-02-17T08:27:09.827 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:27:09.832 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-17T08:27:09.834 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:27:08.397+0000 7f25e50bdec0 0 load: jerasure load: lrc 2026-02-17T08:27:09.835 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_ec_recovery_unfound td/test-erasure-eio 2026-02-17T08:27:09.835 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:609: TEST_ec_recovery_unfound: local dir=td/test-erasure-eio 2026-02-17T08:27:09.835 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:610: TEST_ec_recovery_unfound: local objname=myobject 2026-02-17T08:27:09.835 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:611: TEST_ec_recovery_unfound: local lastobj=100 2026-02-17T08:27:09.836 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:613: TEST_ec_recovery_unfound: local testobj=obj75 2026-02-17T08:27:09.836 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:615: TEST_ec_recovery_unfound: ORIG_ARGS='--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:27:09.836 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:616: TEST_ec_recovery_unfound: CEPH_ARGS+=' --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 ' 2026-02-17T08:27:09.836 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:617: TEST_ec_recovery_unfound: CEPH_ARGS+=' --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-17T08:27:09.836 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:618: TEST_ec_recovery_unfound: setup_osds 5 2026-02-17T08:27:09.836 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=5 2026-02-17T08:27:09.836 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-17T08:27:09.836 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 5 - 1 2026-02-17T08:27:09.839 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 4 2026-02-17T08:27:09.839 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:27:09.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-17T08:27:09.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:27:09.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:27:09.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:27:09.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:27:09.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-17T08:27:09.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-17T08:27:09.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:27:09.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:27:09.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:27:09.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-17T08:27:09.841 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-17T08:27:09.841 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:27:09.841 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:27:09.841 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:27:09.841 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:27:09.841 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:27:09.841 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:27:09.841 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:27:09.841 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:27:09.841 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:27:09.841 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:27:09.841 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:27:09.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:27:09.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:27:09.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:27:09.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:27:09.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:27:09.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:27:09.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:27:09.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:27:09.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:27:09.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:27:09.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:27:09.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-17T08:27:09.843 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:27:09.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=b071b245-f376-4758-a9fd-e45fe2339ce2 2026-02-17T08:27:09.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 b071b245-f376-4758-a9fd-e45fe2339ce2' 2026-02-17T08:27:09.844 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 b071b245-f376-4758-a9fd-e45fe2339ce2 2026-02-17T08:27:09.844 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:27:09.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBdJpRp7yk9MhAALsMSFLx3nOpJs3RKm/9lEA== 2026-02-17T08:27:09.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBdJpRp7yk9MhAALsMSFLx3nOpJs3RKm/9lEA=="}' 2026-02-17T08:27:09.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new b071b245-f376-4758-a9fd-e45fe2339ce2 -i td/test-erasure-eio/0/new.json 2026-02-17T08:27:09.966 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:27:09.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-17T08:27:09.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBdJpRp7yk9MhAALsMSFLx3nOpJs3RKm/9lEA== --osd-uuid b071b245-f376-4758-a9fd-e45fe2339ce2 2026-02-17T08:27:09.993 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:09.977+0000 7f5c9ee438c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:09.994 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:09.981+0000 7f5c9ee438c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:09.995 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:09.981+0000 7f5c9ee438c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:09.996 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:09.981+0000 7f5c9ee438c0 -1 bdev(0x55f1cfd1bc00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:27:09.996 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:09.981+0000 7f5c9ee438c0 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-17T08:27:12.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-17T08:27:12.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:27:12.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:27:12.300 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:27:12.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:27:12.581 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:27:12.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:27:12.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:27:12.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:27:12.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:27:12.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:27:12.610 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:12.597+0000 7f6f8bfb18c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:12.612 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:12.597+0000 7f6f8bfb18c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:12.613 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:12.597+0000 7f6f8bfb18c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:12.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:27:12.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:27:12.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:27:12.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:27:12.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:27:12.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:12.787 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:27:12.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:27:12.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:12.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:27:12.988 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:27:13.989 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:27:13.989 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:13.989 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:27:13.990 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:27:13.990 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:13.990 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:27:14.192 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:27:14.343 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:14.329+0000 7f6f8bfb18c0 -1 Falling back to public interface 2026-02-17T08:27:15.194 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:27:15.194 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:15.194 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:27:15.194 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:27:15.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:15.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:27:15.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:27:16.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:27:16.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:16.401 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:27:16.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:27:16.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:16.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:27:16.604 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:27:17.332 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:17.317+0000 7f6f8bfb18c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:27:17.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:27:17.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:17.606 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:27:17.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:27:17.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:17.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:27:17.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:27:18.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:27:18.827 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:18.827 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:27:18.828 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:27:18.828 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:18.828 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:27:19.028 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2139101908,v1:127.0.0.1:6803/2139101908] [v2:127.0.0.1:6804/2139101908,v1:127.0.0.1:6805/2139101908] exists,up b071b245-f376-4758-a9fd-e45fe2339ce2 2026-02-17T08:27:19.031 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:27:19.031 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:27:19.031 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:27:19.031 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:27:19.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-17T08:27:19.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:27:19.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:27:19.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T08:27:19.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:27:19.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-17T08:27:19.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-17T08:27:19.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:27:19.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:27:19.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:27:19.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-17T08:27:19.033 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-17T08:27:19.033 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:27:19.033 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:27:19.033 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:27:19.033 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:27:19.033 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:27:19.033 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:27:19.033 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:27:19.033 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:27:19.033 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:27:19.033 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:27:19.033 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:27:19.033 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:27:19.034 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:27:19.034 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:27:19.034 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:27:19.034 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:27:19.034 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:27:19.034 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:27:19.034 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:27:19.034 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:27:19.034 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:27:19.034 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:27:19.034 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-17T08:27:19.034 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:27:19.035 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=f9ef8bc8-ceb8-464d-a568-56c4d9d3225e 2026-02-17T08:27:19.035 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 f9ef8bc8-ceb8-464d-a568-56c4d9d3225e' 2026-02-17T08:27:19.036 INFO:tasks.workunit.client.0.trial059.stdout:add osd1 f9ef8bc8-ceb8-464d-a568-56c4d9d3225e 2026-02-17T08:27:19.036 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:27:19.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBnJpRpKDH9ARAA3JOkFOPDRdHXomS6b5kuqA== 2026-02-17T08:27:19.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBnJpRpKDH9ARAA3JOkFOPDRdHXomS6b5kuqA=="}' 2026-02-17T08:27:19.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new f9ef8bc8-ceb8-464d-a568-56c4d9d3225e -i td/test-erasure-eio/1/new.json 2026-02-17T08:27:19.252 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:27:19.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-17T08:27:19.262 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBnJpRpKDH9ARAA3JOkFOPDRdHXomS6b5kuqA== --osd-uuid f9ef8bc8-ceb8-464d-a568-56c4d9d3225e 2026-02-17T08:27:19.281 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:19.265+0000 7f50705b08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:19.283 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:19.269+0000 7f50705b08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:19.284 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:19.269+0000 7f50705b08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:19.284 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:19.269+0000 7f50705b08c0 -1 bdev(0x55a0fc4d1c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-17T08:27:19.285 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:19.269+0000 7f50705b08c0 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-17T08:27:21.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-17T08:27:21.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:27:21.560 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T08:27:21.560 INFO:tasks.workunit.client.0.trial059.stdout:adding osd1 key to auth repository 2026-02-17T08:27:21.560 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:27:21.840 INFO:tasks.workunit.client.0.trial059.stdout:start osd.1 2026-02-17T08:27:21.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T08:27:21.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:27:21.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:27:21.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:27:21.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:27:21.868 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:21.853+0000 7f77974d28c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:21.870 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:21.857+0000 7f77974d28c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:21.871 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:21.857+0000 7f77974d28c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:22.041 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T08:27:22.041 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:27:22.042 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:27:22.042 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:27:22.042 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:27:22.042 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:22.042 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:27:22.042 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:27:22.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:22.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:27:22.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:27:23.248 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:27:23.248 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:23.248 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:27:23.249 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:27:23.249 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:23.249 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:27:23.367 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:23.353+0000 7f77974d28c0 -1 Falling back to public interface 2026-02-17T08:27:23.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:27:24.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:27:24.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:24.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:27:24.453 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:27:24.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:24.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:27:24.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:27:25.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:27:25.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:25.661 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:27:25.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:27:25.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:25.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:27:25.864 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:27:26.367 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:26.353+0000 7f77974d28c0 -1 osd.1 0 log_to_monitors true 2026-02-17T08:27:26.866 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:27:26.866 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:26.866 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:27:26.867 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:27:26.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:26.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:27:27.065 INFO:tasks.workunit.client.0.trial059.stdout:osd.1 up in weight 1 up_from 12 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3008805572,v1:127.0.0.1:6811/3008805572] [v2:127.0.0.1:6812/3008805572,v1:127.0.0.1:6813/3008805572] exists,up f9ef8bc8-ceb8-464d-a568-56c4d9d3225e 2026-02-17T08:27:27.070 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:27:27.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:27:27.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:27:27.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:27:27.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-17T08:27:27.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:27:27.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:27:27.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T08:27:27.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:27:27.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-17T08:27:27.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-17T08:27:27.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:27:27.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:27:27.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:27:27.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-17T08:27:27.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-17T08:27:27.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:27:27.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:27:27.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:27:27.072 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:27:27.073 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:27:27.073 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:27:27.073 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:27:27.073 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:27:27.073 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:27:27.073 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:27:27.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:27:27.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:27:27.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:27:27.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:27:27.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:27:27.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:27:27.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:27:27.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:27:27.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:27:27.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:27:27.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:27:27.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:27:27.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-17T08:27:27.075 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:27:27.075 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=6f717e78-353a-4ffd-bf33-70177962eb95 2026-02-17T08:27:27.075 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 6f717e78-353a-4ffd-bf33-70177962eb95' 2026-02-17T08:27:27.075 INFO:tasks.workunit.client.0.trial059.stdout:add osd2 6f717e78-353a-4ffd-bf33-70177962eb95 2026-02-17T08:27:27.076 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:27:27.084 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBvJpRpvUpJBBAASqG3C/9SaGYQlb0qQOEqEA== 2026-02-17T08:27:27.085 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBvJpRpvUpJBBAASqG3C/9SaGYQlb0qQOEqEA=="}' 2026-02-17T08:27:27.085 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 6f717e78-353a-4ffd-bf33-70177962eb95 -i td/test-erasure-eio/2/new.json 2026-02-17T08:27:27.295 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:27:27.303 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-17T08:27:27.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBvJpRpvUpJBBAASqG3C/9SaGYQlb0qQOEqEA== --osd-uuid 6f717e78-353a-4ffd-bf33-70177962eb95 2026-02-17T08:27:27.323 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:27.308+0000 7f569ea148c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:27.324 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:27.308+0000 7f569ea148c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:27.326 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:27.312+0000 7f569ea148c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:27.326 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:27.312+0000 7f569ea148c0 -1 bdev(0x55c1163dfc00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-17T08:27:27.326 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:27.312+0000 7f569ea148c0 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-17T08:27:29.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-17T08:27:29.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:27:29.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T08:27:29.657 INFO:tasks.workunit.client.0.trial059.stdout:adding osd2 key to auth repository 2026-02-17T08:27:29.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:27:29.929 INFO:tasks.workunit.client.0.trial059.stdout:start osd.2 2026-02-17T08:27:29.930 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T08:27:29.930 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:27:29.930 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:27:29.930 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:27:29.930 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:27:29.947 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:29.932+0000 7fda559f28c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:29.949 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:29.932+0000 7fda559f28c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:29.950 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:29.936+0000 7fda559f28c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:30.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T08:27:30.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:27:30.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:27:30.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:27:30.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:27:30.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:30.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:27:30.133 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:27:30.134 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:30.134 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:27:30.336 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:27:31.337 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:27:31.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:31.338 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:27:31.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:27:31.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:31.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:27:31.463 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:31.448+0000 7fda559f28c0 -1 Falling back to public interface 2026-02-17T08:27:31.543 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:27:32.545 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:27:32.545 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:32.545 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:27:32.545 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:27:32.546 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:32.546 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:27:32.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:27:33.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:27:33.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:33.751 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:27:33.751 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:27:33.751 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:33.751 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:27:33.947 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:27:34.701 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:34.684+0000 7fda559f28c0 -1 osd.2 0 log_to_monitors true 2026-02-17T08:27:34.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:27:34.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:34.949 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:27:34.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:27:34.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:34.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:27:35.152 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:27:36.154 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:27:36.154 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:36.154 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:27:36.155 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:27:36.155 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:36.155 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:27:36.354 INFO:tasks.workunit.client.0.trial059.stdout:osd.2 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1111095905,v1:127.0.0.1:6819/1111095905] [v2:127.0.0.1:6820/1111095905,v1:127.0.0.1:6821/1111095905] exists,up 6f717e78-353a-4ffd-bf33-70177962eb95 2026-02-17T08:27:36.357 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:27:36.357 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:27:36.357 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:27:36.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:27:36.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-17T08:27:36.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:27:36.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:27:36.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2026-02-17T08:27:36.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:27:36.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-17T08:27:36.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-17T08:27:36.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:27:36.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:27:36.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:27:36.359 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-17T08:27:36.359 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-17T08:27:36.359 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:27:36.359 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:27:36.359 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:27:36.359 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:27:36.359 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:27:36.359 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:27:36.359 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:27:36.359 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:27:36.359 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:27:36.359 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:27:36.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:27:36.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:27:36.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:27:36.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:27:36.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:27:36.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:27:36.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:27:36.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:27:36.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:27:36.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:27:36.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:27:36.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:27:36.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-17T08:27:36.361 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:27:36.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=580bf11a-3b2f-48d1-9d35-bbc481b98bcf 2026-02-17T08:27:36.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 580bf11a-3b2f-48d1-9d35-bbc481b98bcf' 2026-02-17T08:27:36.362 INFO:tasks.workunit.client.0.trial059.stdout:add osd3 580bf11a-3b2f-48d1-9d35-bbc481b98bcf 2026-02-17T08:27:36.362 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:27:36.373 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQB4JpRpd5R4FRAAdglTYCxyoV9NbEMXCqAYrg== 2026-02-17T08:27:36.373 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQB4JpRpd5R4FRAAdglTYCxyoV9NbEMXCqAYrg=="}' 2026-02-17T08:27:36.374 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 580bf11a-3b2f-48d1-9d35-bbc481b98bcf -i td/test-erasure-eio/3/new.json 2026-02-17T08:27:36.567 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:27:36.578 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-17T08:27:36.579 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB4JpRpd5R4FRAAdglTYCxyoV9NbEMXCqAYrg== --osd-uuid 580bf11a-3b2f-48d1-9d35-bbc481b98bcf 2026-02-17T08:27:36.606 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:36.592+0000 7fc24cda78c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:36.607 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:36.592+0000 7fc24cda78c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:36.608 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:36.592+0000 7fc24cda78c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:36.609 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:36.592+0000 7fc24cda78c0 -1 bdev(0x5558d8d4dc00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-17T08:27:36.609 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:36.592+0000 7fc24cda78c0 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-17T08:27:38.875 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-17T08:27:38.875 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:27:38.876 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2026-02-17T08:27:38.877 INFO:tasks.workunit.client.0.trial059.stdout:adding osd3 key to auth repository 2026-02-17T08:27:38.877 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:27:39.152 INFO:tasks.workunit.client.0.trial059.stdout:start osd.3 2026-02-17T08:27:39.154 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2026-02-17T08:27:39.154 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:27:39.154 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:27:39.154 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:27:39.154 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:27:39.181 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:39.164+0000 7f922a99c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:39.183 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:39.168+0000 7f922a99c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:39.184 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:39.168+0000 7f922a99c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:39.353 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2026-02-17T08:27:39.353 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:27:39.353 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T08:27:39.353 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:27:39.353 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:27:39.353 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:39.354 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:27:39.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:27:39.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:39.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:27:39.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:27:40.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:27:40.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:40.559 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:27:40.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:27:40.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:40.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:27:40.688 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:40.672+0000 7f922a99c8c0 -1 Falling back to public interface 2026-02-17T08:27:40.760 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:27:41.761 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:27:41.762 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:41.762 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:27:41.763 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:27:41.763 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:41.763 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:27:41.962 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:27:42.963 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:27:42.963 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:42.964 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:27:42.964 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:27:42.964 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:42.964 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:27:43.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:27:43.890 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:43.876+0000 7f922a99c8c0 -1 osd.3 0 log_to_monitors true 2026-02-17T08:27:44.168 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:27:44.168 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:44.168 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:27:44.169 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:27:44.169 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:44.169 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:27:44.375 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:27:45.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:27:45.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:45.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:27:45.378 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:27:45.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:45.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:27:45.578 INFO:tasks.workunit.client.0.trial059.stdout:osd.3 up in weight 1 up_from 26 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/400880229,v1:127.0.0.1:6827/400880229] [v2:127.0.0.1:6828/400880229,v1:127.0.0.1:6829/400880229] exists,up 580bf11a-3b2f-48d1-9d35-bbc481b98bcf 2026-02-17T08:27:45.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:27:45.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:27:45.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:27:45.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:27:45.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 4 2026-02-17T08:27:45.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:27:45.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:27:45.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2026-02-17T08:27:45.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:27:45.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/4 2026-02-17T08:27:45.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10' 2026-02-17T08:27:45.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:27:45.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:27:45.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:27:45.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/4' 2026-02-17T08:27:45.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/4/journal' 2026-02-17T08:27:45.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:27:45.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:27:45.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:27:45.584 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:27:45.584 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:27:45.584 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:27:45.584 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:27:45.584 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:27:45.584 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:27:45.584 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:27:45.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:27:45.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:27:45.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:27:45.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:27:45.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:27:45.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:27:45.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:27:45.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:27:45.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:27:45.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:27:45.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:27:45.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:27:45.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/4 2026-02-17T08:27:45.586 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:27:45.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=cadb6a3a-8b38-48c9-82de-7a1cfe6039b9 2026-02-17T08:27:45.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 cadb6a3a-8b38-48c9-82de-7a1cfe6039b9' 2026-02-17T08:27:45.587 INFO:tasks.workunit.client.0.trial059.stdout:add osd4 cadb6a3a-8b38-48c9-82de-7a1cfe6039b9 2026-02-17T08:27:45.587 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:27:45.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCBJpRp3HfeIhAAOwZlwHXUgoXGgal2v6qJOw== 2026-02-17T08:27:45.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCBJpRp3HfeIhAAOwZlwHXUgoXGgal2v6qJOw=="}' 2026-02-17T08:27:45.598 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new cadb6a3a-8b38-48c9-82de-7a1cfe6039b9 -i td/test-erasure-eio/4/new.json 2026-02-17T08:27:45.821 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:27:45.830 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/4/new.json 2026-02-17T08:27:45.831 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCBJpRp3HfeIhAAOwZlwHXUgoXGgal2v6qJOw== --osd-uuid cadb6a3a-8b38-48c9-82de-7a1cfe6039b9 2026-02-17T08:27:45.850 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:45.836+0000 7fd04ac618c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:45.852 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:45.836+0000 7fd04ac618c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:45.853 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:45.836+0000 7fd04ac618c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:45.853 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:45.836+0000 7fd04ac618c0 -1 bdev(0x55a7101efc00 td/test-erasure-eio/4/block) open stat got: (1) Operation not permitted 2026-02-17T08:27:45.853 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:45.836+0000 7fd04ac618c0 -1 bluestore(td/test-erasure-eio/4) _read_fsid unparsable uuid 2026-02-17T08:27:48.131 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/4/keyring 2026-02-17T08:27:48.131 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:27:48.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2026-02-17T08:27:48.132 INFO:tasks.workunit.client.0.trial059.stdout:adding osd4 key to auth repository 2026-02-17T08:27:48.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:27:48.407 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2026-02-17T08:27:48.408 INFO:tasks.workunit.client.0.trial059.stdout:start osd.4 2026-02-17T08:27:48.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-recovery-max-single-start 3 --osd-recovery-max-active 3 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:27:48.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:27:48.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:27:48.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:27:48.434 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:48.420+0000 7fa0cfca68c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:48.436 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:48.420+0000 7fa0cfca68c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:48.437 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:48.420+0000 7fa0cfca68c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:27:48.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2026-02-17T08:27:48.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:27:48.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2026-02-17T08:27:48.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:27:48.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:27:48.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:48.609 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:27:48.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:27:48.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:48.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:27:48.816 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:27:49.817 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:27:49.818 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:49.818 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:27:49.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:27:49.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:49.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:27:50.024 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:27:50.412 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:50.396+0000 7fa0cfca68c0 -1 Falling back to public interface 2026-02-17T08:27:51.026 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:27:51.026 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:51.026 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:27:51.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:27:51.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:51.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:27:51.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:27:52.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:27:52.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:52.228 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:27:52.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:27:52.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:52.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:27:52.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:27:53.382 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:27:53.368+0000 7fa0cfca68c0 -1 osd.4 0 log_to_monitors true 2026-02-17T08:27:53.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:27:53.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:53.432 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:27:53.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:27:53.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:53.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:27:53.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:27:54.635 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:27:54.635 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:27:54.636 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:27:54.636 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:27:54.636 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:27:54.636 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:27:54.837 INFO:tasks.workunit.client.0.trial059.stdout:osd.4 up in weight 1 up_from 35 up_thru 36 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/3806760923,v1:127.0.0.1:6835/3806760923] [v2:127.0.0.1:6836/3806760923,v1:127.0.0.1:6837/3806760923] exists,up cadb6a3a-8b38-48c9-82de-7a1cfe6039b9 2026-02-17T08:27:54.838 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:27:54.838 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:27:54.839 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:27:54.839 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-17T08:27:54.839 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:27:54.839 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:27:54.839 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:27:54.839 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:27:54.839 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:27:54.839 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.0.asok 2026-02-17T08:27:54.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-17T08:27:54.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.0.asok log flush 2026-02-17T08:27:54.893 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:27:54.898 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-17T08:27:54.901 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:27:14.333+0000 7f6f8bfb18c0 0 load: jerasure load: lrc 2026-02-17T08:27:54.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:619: TEST_ec_recovery_unfound: CEPH_ARGS='--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:27:54.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:621: TEST_ec_recovery_unfound: local poolname=pool-jerasure 2026-02-17T08:27:54.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:622: TEST_ec_recovery_unfound: create_erasure_coded_pool pool-jerasure 3 2 2026-02-17T08:27:54.903 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:27:54.903 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-17T08:27:54.903 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=3 2026-02-17T08:27:54.903 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-17T08:27:54.903 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=2 2026-02-17T08:27:54.903 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-17T08:27:54.903 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=3 m=2 crush-failure-domain=osd 2026-02-17T08:27:55.158 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-17T08:27:55.158 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-17T08:27:55.516 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' already exists 2026-02-17T08:27:55.525 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:27:56.527 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-17T08:27:56.527 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:27:56.527 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:27:56.527 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:27:56.528 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:27:56.528 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:27:56.528 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:27:56.529 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:27:56.529 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:27:56.529 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:27:56.642 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:27:56.642 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:27:56.642 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:27:56.642 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:27:56.642 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:27:56.642 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:27:56.838 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:27:56.839 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:27:56.839 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:27:56.839 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:27:56.839 INFO:tasks.workunit.client.0.trial059.stderr:4' 2026-02-17T08:27:56.839 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:27:56.839 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:27:56.839 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:27:56.914 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803786 2026-02-17T08:27:56.914 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803786 2026-02-17T08:27:56.914 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803786' 2026-02-17T08:27:56.914 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:27:56.915 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:27:56.987 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=51539607560 2026-02-17T08:27:56.987 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 51539607560 2026-02-17T08:27:56.988 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803786 1-51539607560' 2026-02-17T08:27:56.988 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:27:56.988 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:27:57.064 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411335 2026-02-17T08:27:57.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411335 2026-02-17T08:27:57.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803786 1-51539607560 2-77309411335' 2026-02-17T08:27:57.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:27:57.065 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:27:57.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=111669149701 2026-02-17T08:27:57.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 111669149701 2026-02-17T08:27:57.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803786 1-51539607560 2-77309411335 3-111669149701' 2026-02-17T08:27:57.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:27:57.140 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:27:57.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=150323855363 2026-02-17T08:27:57.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 150323855363 2026-02-17T08:27:57.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803786 1-51539607560 2-77309411335 3-111669149701 4-150323855363' 2026-02-17T08:27:57.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:27:57.218 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803786 2026-02-17T08:27:57.218 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:27:57.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:27:57.219 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803786 2026-02-17T08:27:57.219 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:27:57.221 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803786 2026-02-17T08:27:57.221 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803786' 2026-02-17T08:27:57.221 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 25769803786 2026-02-17T08:27:57.222 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:27:57.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803784 -lt 25769803786 2026-02-17T08:27:57.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:27:58.418 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:27:58.419 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:27:58.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803784 -lt 25769803786 2026-02-17T08:27:58.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:27:59.622 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T08:27:59.623 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:27:59.815 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803787 -lt 25769803786 2026-02-17T08:27:59.815 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:27:59.816 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-51539607560 2026-02-17T08:27:59.816 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:27:59.817 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:27:59.818 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-51539607560 2026-02-17T08:27:59.818 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:27:59.820 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=51539607560 2026-02-17T08:27:59.820 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 51539607560 2026-02-17T08:27:59.820 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 51539607560' 2026-02-17T08:27:59.820 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:28:00.019 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 51539607561 -lt 51539607560 2026-02-17T08:28:00.020 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:28:00.020 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-77309411335 2026-02-17T08:28:00.020 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:28:00.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:28:00.022 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-77309411335 2026-02-17T08:28:00.022 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:28:00.024 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411335 2026-02-17T08:28:00.024 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 77309411335' 2026-02-17T08:28:00.024 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 77309411335 2026-02-17T08:28:00.024 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:28:00.222 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411335 -lt 77309411335 2026-02-17T08:28:00.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:28:00.223 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-111669149701 2026-02-17T08:28:00.223 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:28:00.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:28:00.225 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-111669149701 2026-02-17T08:28:00.225 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:28:00.226 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=111669149701 2026-02-17T08:28:00.226 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 111669149701 2026-02-17T08:28:00.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 111669149701' 2026-02-17T08:28:00.227 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:28:00.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 111669149701 -lt 111669149701 2026-02-17T08:28:00.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:28:00.427 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-150323855363 2026-02-17T08:28:00.427 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:28:00.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:28:00.429 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-150323855363 2026-02-17T08:28:00.429 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:28:00.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=150323855363 2026-02-17T08:28:00.431 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.4 seq 150323855363 2026-02-17T08:28:00.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 150323855363' 2026-02-17T08:28:00.431 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:28:00.631 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 150323855363 -lt 150323855363 2026-02-17T08:28:00.632 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:28:00.632 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:28:00.632 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:28:00.896 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:28:00.896 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:28:00.896 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:28:00.896 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:28:00.896 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:28:00.896 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:28:00.896 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:28:00.897 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:28:01.093 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:28:01.094 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:28:01.094 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:28:01.094 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:28:01.356 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:28:01.356 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:28:01.356 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:28:01.356 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:624: TEST_ec_recovery_unfound: ceph pg dump pgs 2026-02-17T08:28:01.541 INFO:tasks.workunit.client.0.trial059.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T08:28:01.541 INFO:tasks.workunit.client.0.trial059.stdout:2.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:27:56.628494+0000 0'0 43:15 [3,1,4,0,2] 3 [3,1,4,0,2] 3 0'0 2026-02-17T08:27:55.454306+0000 0'0 2026-02-17T08:27:55.454306+0000 0 0 periodic scrub scheduled @ 2026-02-18T08:33:13.967767+0000 0 0 2026-02-17T08:28:01.541 INFO:tasks.workunit.client.0.trial059.stdout:1.3 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:27:54.225886+0000 0'0 43:22 [4,1,2] 4 [4,1,2] 4 0'0 2026-02-17T08:27:08.738834+0000 0'0 2026-02-17T08:27:08.738834+0000 0 0 periodic scrub scheduled @ 2026-02-18T10:16:23.529415+0000 0 0 2026-02-17T08:28:01.541 INFO:tasks.workunit.client.0.trial059.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:27:54.225399+0000 0'0 42:91 [0,4,1] 0 [0,4,1] 0 0'0 2026-02-17T08:27:08.738834+0000 0'0 2026-02-17T08:27:08.738834+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:00:37.386565+0000 0 0 2026-02-17T08:28:01.541 INFO:tasks.workunit.client.0.trial059.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:27:54.225390+0000 0'0 43:22 [4,3,0] 4 [4,3,0] 4 0'0 2026-02-17T08:27:08.738834+0000 0'0 2026-02-17T08:27:08.738834+0000 0 0 periodic scrub scheduled @ 2026-02-18T10:41:05.570301+0000 0 0 2026-02-17T08:28:01.542 INFO:tasks.workunit.client.0.trial059.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:27:36.609631+0000 0'0 43:64 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T08:27:08.738834+0000 0'0 2026-02-17T08:27:08.738834+0000 0 0 periodic scrub scheduled @ 2026-02-18T14:37:41.329499+0000 0 0 2026-02-17T08:28:01.542 INFO:tasks.workunit.client.0.trial059.stdout: 2026-02-17T08:28:01.542 INFO:tasks.workunit.client.0.trial059.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T08:28:01.542 INFO:tasks.workunit.client.0.trial059.stderr:dumped pgs 2026-02-17T08:28:01.552 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:626: TEST_ec_recovery_unfound: rados_put td/test-erasure-eio pool-jerasure myobject 2026-02-17T08:28:01.552 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-17T08:28:01.552 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-17T08:28:01.552 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=myobject 2026-02-17T08:28:01.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:28:01.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-17T08:28:01.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:28:01.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-17T08:28:01.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:28:01.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-17T08:28:01.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:28:01.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-17T08:28:01.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put myobject td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:01.572 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:628: TEST_ec_recovery_unfound: get_osds pool-jerasure myobject 2026-02-17T08:28:01.572 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:28:01.573 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=myobject 2026-02-17T08:28:01.573 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-17T08:28:01.573 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:28:01.769 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:28:01.769 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:28:01.770 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:28:01.770 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:28:01.770 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:28:01.770 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 4 0 2 2026-02-17T08:28:01.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:628: TEST_ec_recovery_unfound: initial_osds=('3' '1' '4' '0' '2') 2026-02-17T08:28:01.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:628: TEST_ec_recovery_unfound: local -a initial_osds 2026-02-17T08:28:01.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:629: TEST_ec_recovery_unfound: local last_osd=2 2026-02-17T08:28:01.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:630: TEST_ec_recovery_unfound: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-17T08:28:01.770 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:28:01.770 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:28:01.771 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:28:01.771 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:28:01.771 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:28:03.080 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:28:03.080 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:631: TEST_ec_recovery_unfound: ceph osd down 2 2026-02-17T08:28:03.272 INFO:tasks.workunit.client.0.trial059.stderr:osd.2 is already down. 2026-02-17T08:28:03.282 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:632: TEST_ec_recovery_unfound: ceph osd out 2 2026-02-17T08:28:03.543 INFO:tasks.workunit.client.0.trial059.stderr:osd.2 is already out. 2026-02-17T08:28:03.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:634: TEST_ec_recovery_unfound: ceph pg dump pgs 2026-02-17T08:28:03.751 INFO:tasks.workunit.client.0.trial059.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T08:28:03.751 INFO:tasks.workunit.client.0.trial059.stdout:2.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:27:56.628494+0000 0'0 43:15 [3,1,4,0,2] 3 [3,1,4,0,2] 3 0'0 2026-02-17T08:27:55.454306+0000 0'0 2026-02-17T08:27:55.454306+0000 0 0 periodic scrub scheduled @ 2026-02-18T08:33:13.967767+0000 0 0 2026-02-17T08:28:03.751 INFO:tasks.workunit.client.0.trial059.stdout:1.3 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:27:54.225886+0000 0'0 43:22 [4,1,2] 4 [4,1,2] 4 0'0 2026-02-17T08:27:08.738834+0000 0'0 2026-02-17T08:27:08.738834+0000 0 0 periodic scrub scheduled @ 2026-02-18T10:16:23.529415+0000 0 0 2026-02-17T08:28:03.751 INFO:tasks.workunit.client.0.trial059.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:27:54.225399+0000 0'0 45:97 [0,4,1] 0 [0,4,1] 0 0'0 2026-02-17T08:27:08.738834+0000 0'0 2026-02-17T08:27:08.738834+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:00:37.386565+0000 0 0 2026-02-17T08:28:03.751 INFO:tasks.workunit.client.0.trial059.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:27:54.225390+0000 0'0 43:22 [4,3,0] 4 [4,3,0] 4 0'0 2026-02-17T08:27:08.738834+0000 0'0 2026-02-17T08:27:08.738834+0000 0 0 periodic scrub scheduled @ 2026-02-18T10:41:05.570301+0000 0 0 2026-02-17T08:28:03.752 INFO:tasks.workunit.client.0.trial059.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+undersized 2026-02-17T08:28:01.914026+0000 0'0 45:71 [1,0] 1 [1,0] 1 0'0 2026-02-17T08:27:08.738834+0000 0'0 2026-02-17T08:27:08.738834+0000 0 0 no scrub is scheduled 0 0 2026-02-17T08:28:03.752 INFO:tasks.workunit.client.0.trial059.stdout: 2026-02-17T08:28:03.752 INFO:tasks.workunit.client.0.trial059.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T08:28:03.752 INFO:tasks.workunit.client.0.trial059.stderr:dumped pgs 2026-02-17T08:28:03.762 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:636: TEST_ec_recovery_unfound: dd if=/dev/urandom of=td/test-erasure-eio/ORIGINAL bs=1024 count=4 2026-02-17T08:28:03.763 INFO:tasks.workunit.client.0.trial059.stderr:4+0 records in 2026-02-17T08:28:03.763 INFO:tasks.workunit.client.0.trial059.stderr:4+0 records out 2026-02-17T08:28:03.763 INFO:tasks.workunit.client.0.trial059.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000115863 s, 35.4 MB/s 2026-02-17T08:28:03.763 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: seq 1 100 2026-02-17T08:28:03.764 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:03.764 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj1 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:03.784 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:03.784 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj2 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:03.809 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:03.809 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj3 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:03.827 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:03.827 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj4 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:03.850 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:03.850 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj5 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:03.874 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:03.875 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj6 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:03.899 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:03.899 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj7 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:03.924 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:03.924 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj8 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:03.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:03.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj9 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:03.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:03.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj10 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:03.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:03.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj11 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.019 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj12 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj13 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.069 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.069 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj14 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.088 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.088 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj15 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.110 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.110 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj16 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.130 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.131 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj17 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.157 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.157 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj18 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj19 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.208 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.208 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj20 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.226 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.226 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj21 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.251 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.251 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj22 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.276 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.276 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj23 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.302 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.302 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj24 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.327 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.327 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj25 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.352 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.353 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj26 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj27 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj28 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj29 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj30 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.476 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.476 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj31 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.494 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj32 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj33 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.538 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.538 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj34 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.556 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.556 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj35 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.580 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.580 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj36 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.604 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.604 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj37 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.630 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.630 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj38 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj39 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj40 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.702 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.702 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj41 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.720 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj42 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj43 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.767 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj44 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj45 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.816 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.816 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj46 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.841 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.841 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj47 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.858 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.858 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj48 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.879 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.879 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj49 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj50 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.927 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.927 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj51 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj52 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:04.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:04.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj53 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.004 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.004 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj54 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.028 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.028 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj55 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.054 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.055 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj56 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.081 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.081 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj57 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj58 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj59 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj60 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj61 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.211 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.211 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj62 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.230 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.230 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj63 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.253 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.253 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj64 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj65 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.303 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.303 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj66 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.322 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.323 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj67 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.340 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.340 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj68 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.364 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.364 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj69 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.388 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.388 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj70 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj71 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.439 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.439 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj72 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.465 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.465 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj73 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.491 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.491 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj74 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.517 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.517 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj75 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj76 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj77 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj78 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj79 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.631 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj80 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.654 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj81 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj82 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.699 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj83 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.723 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.723 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj84 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.747 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.747 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj85 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.767 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.767 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj86 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.792 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj87 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.815 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.815 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj88 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj89 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.858 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.858 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj90 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.882 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.882 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj91 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj92 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.924 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.924 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj93 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.947 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.947 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj94 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj95 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:05.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:05.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj96 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:06.020 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:06.020 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj97 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:06.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:06.046 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj98 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:06.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:06.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj99 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:06.093 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:637: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:06.094 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:639: TEST_ec_recovery_unfound: rados --pool pool-jerasure put obj100 td/test-erasure-eio/ORIGINAL 2026-02-17T08:28:06.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:642: TEST_ec_recovery_unfound: inject_eio ec data pool-jerasure obj75 td/test-erasure-eio 0 2026-02-17T08:28:06.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2457: inject_eio: local pooltype=ec 2026-02-17T08:28:06.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2458: inject_eio: shift 2026-02-17T08:28:06.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2459: inject_eio: local which=data 2026-02-17T08:28:06.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2460: inject_eio: shift 2026-02-17T08:28:06.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2461: inject_eio: local poolname=pool-jerasure 2026-02-17T08:28:06.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2462: inject_eio: shift 2026-02-17T08:28:06.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2463: inject_eio: local objname=obj75 2026-02-17T08:28:06.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2464: inject_eio: shift 2026-02-17T08:28:06.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2465: inject_eio: local dir=td/test-erasure-eio 2026-02-17T08:28:06.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2466: inject_eio: shift 2026-02-17T08:28:06.121 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2467: inject_eio: local shard_id=0 2026-02-17T08:28:06.121 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2468: inject_eio: shift 2026-02-17T08:28:06.121 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: get_osds pool-jerasure obj75 2026-02-17T08:28:06.121 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:28:06.121 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj75 2026-02-17T08:28:06.121 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj75 2026-02-17T08:28:06.121 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:28:06.321 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:28:06.322 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:28:06.322 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:28:06.322 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:28:06.322 INFO:tasks.workunit.client.0.trial059.stderr:2147483647' 2026-02-17T08:28:06.322 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 4 0 2147483647 2026-02-17T08:28:06.322 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: initial_osds=('3' '1' '4' '0' '2147483647') 2026-02-17T08:28:06.322 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: local -a initial_osds 2026-02-17T08:28:06.322 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2471: inject_eio: local osd_id=3 2026-02-17T08:28:06.323 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2472: inject_eio: '[' ec '!=' ec ']' 2026-02-17T08:28:06.323 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: cat td/test-erasure-eio/3/type 2026-02-17T08:28:06.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: type=bluestore 2026-02-17T08:28:06.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2476: inject_eio: set_config osd 3 bluestore_debug_inject_read_err true 2026-02-17T08:28:06.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1161: set_config: local daemon=osd 2026-02-17T08:28:06.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1162: set_config: local id=3 2026-02-17T08:28:06.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1163: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T08:28:06.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1164: set_config: local value=true 2026-02-17T08:28:06.325 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: jq 'has("success")' 2026-02-17T08:28:06.326 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: get_asok_path osd.3 2026-02-17T08:28:06.326 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2026-02-17T08:28:06.326 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2026-02-17T08:28:06.326 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:28:06.326 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:06.326 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:28:06.326 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.3.asok 2026-02-17T08:28:06.326 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.70936/ceph-osd.3.asok config set bluestore_debug_inject_read_err true 2026-02-17T08:28:06.386 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: test true == true 2026-02-17T08:28:06.386 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2477: inject_eio: local loop=0 2026-02-17T08:28:06.387 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2479: inject_eio: grep -q Invalid 2026-02-17T08:28:06.387 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: get_asok_path osd.3 2026-02-17T08:28:06.388 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2026-02-17T08:28:06.388 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2026-02-17T08:28:06.388 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:28:06.388 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:06.388 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:28:06.388 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.3.asok 2026-02-17T08:28:06.389 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: CEPH_ARGS= 2026-02-17T08:28:06.389 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.3.asok injectdataerr pool-jerasure obj75 0 2026-02-17T08:28:06.445 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:643: TEST_ec_recovery_unfound: inject_eio ec data pool-jerasure obj75 td/test-erasure-eio 1 2026-02-17T08:28:06.445 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2457: inject_eio: local pooltype=ec 2026-02-17T08:28:06.445 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2458: inject_eio: shift 2026-02-17T08:28:06.445 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2459: inject_eio: local which=data 2026-02-17T08:28:06.445 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2460: inject_eio: shift 2026-02-17T08:28:06.445 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2461: inject_eio: local poolname=pool-jerasure 2026-02-17T08:28:06.446 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2462: inject_eio: shift 2026-02-17T08:28:06.446 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2463: inject_eio: local objname=obj75 2026-02-17T08:28:06.446 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2464: inject_eio: shift 2026-02-17T08:28:06.446 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2465: inject_eio: local dir=td/test-erasure-eio 2026-02-17T08:28:06.446 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2466: inject_eio: shift 2026-02-17T08:28:06.446 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2467: inject_eio: local shard_id=1 2026-02-17T08:28:06.446 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2468: inject_eio: shift 2026-02-17T08:28:06.446 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: get_osds pool-jerasure obj75 2026-02-17T08:28:06.446 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:28:06.446 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj75 2026-02-17T08:28:06.447 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj75 2026-02-17T08:28:06.447 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:28:06.657 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:28:06.657 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:28:06.657 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:28:06.657 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:28:06.657 INFO:tasks.workunit.client.0.trial059.stderr:2147483647' 2026-02-17T08:28:06.657 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 4 0 2147483647 2026-02-17T08:28:06.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: initial_osds=('3' '1' '4' '0' '2147483647') 2026-02-17T08:28:06.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: local -a initial_osds 2026-02-17T08:28:06.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2471: inject_eio: local osd_id=1 2026-02-17T08:28:06.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2472: inject_eio: '[' ec '!=' ec ']' 2026-02-17T08:28:06.658 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: cat td/test-erasure-eio/1/type 2026-02-17T08:28:06.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: type=bluestore 2026-02-17T08:28:06.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2476: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-17T08:28:06.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1161: set_config: local daemon=osd 2026-02-17T08:28:06.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1162: set_config: local id=1 2026-02-17T08:28:06.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1163: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T08:28:06.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1164: set_config: local value=true 2026-02-17T08:28:06.660 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: jq 'has("success")' 2026-02-17T08:28:06.660 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: get_asok_path osd.1 2026-02-17T08:28:06.660 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2026-02-17T08:28:06.660 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2026-02-17T08:28:06.660 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:28:06.660 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:06.660 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:28:06.661 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.1.asok 2026-02-17T08:28:06.661 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.70936/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-17T08:28:06.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: test true == true 2026-02-17T08:28:06.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2477: inject_eio: local loop=0 2026-02-17T08:28:06.720 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2479: inject_eio: grep -q Invalid 2026-02-17T08:28:06.720 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: get_asok_path osd.1 2026-02-17T08:28:06.720 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2026-02-17T08:28:06.720 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2026-02-17T08:28:06.721 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:28:06.721 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:06.721 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:28:06.721 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.1.asok 2026-02-17T08:28:06.722 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: CEPH_ARGS= 2026-02-17T08:28:06.722 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.1.asok injectdataerr pool-jerasure obj75 1 2026-02-17T08:28:06.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:645: TEST_ec_recovery_unfound: activate_osd td/test-erasure-eio 2 2026-02-17T08:28:06.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-eio 2026-02-17T08:28:06.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:28:06.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=2 2026-02-17T08:28:06.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:28:06.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-17T08:28:06.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:28:06.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:28:06.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:28:06.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:28:06.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-17T08:28:06.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-17T08:28:06.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:28:06.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:28:06.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:28:06.780 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:28:06.780 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:28:06.780 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:28:06.781 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:28:06.782 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:06.782 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:28:06.782 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:28:06.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:28:06.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:28:06.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:28:06.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:28:06.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:28:06.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:28:06.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:28:06.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:28:06.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:28:06.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:28:06.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-17T08:28:06.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.2 2026-02-17T08:28:06.783 INFO:tasks.workunit.client.0.trial059.stdout:start osd.2 2026-02-17T08:28:06.784 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:28:06.784 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-17T08:28:06.784 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 2 = 2 ']' 2026-02-17T08:28:06.784 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:28:06.784 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:28:06.784 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:28:06.804 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:06.787+0000 7f9d1d7b98c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:06.805 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:06.787+0000 7f9d1d7b98c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:06.806 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:06.787+0000 7f9d1d7b98c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:06.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 2 2026-02-17T08:28:06.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:28:06.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:28:06.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:28:06.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:28:06.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:06.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:28:06.975 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:28:06.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:06.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:28:07.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:08.037 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:08.019+0000 7f9d1d7b98c0 -1 Falling back to public interface 2026-02-17T08:28:08.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:08.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:08.174 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:28:08.174 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:28:08.174 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:08.175 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:28:08.374 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:09.375 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:09.375 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:09.376 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:28:09.376 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:28:09.376 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:09.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:28:09.574 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:10.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:10.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:10.576 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:28:10.576 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:28:10.576 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:10.577 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:28:10.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:11.126 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:11.107+0000 7f9d1d7b98c0 -1 osd.2 43 log_to_monitors true 2026-02-17T08:28:11.776 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:11.776 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:11.776 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:28:11.777 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:28:11.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:11.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:28:11.980 INFO:tasks.workunit.client.0.trial059.stdout:osd.2 up out weight 0 up_from 49 up_thru 20 down_at 44 last_clean_interval [18,43) [v2:127.0.0.1:6818/3473448035,v1:127.0.0.1:6819/3473448035] [v2:127.0.0.1:6820/3473448035,v1:127.0.0.1:6821/3473448035] exists,up 6f717e78-353a-4ffd-bf33-70177962eb95 2026-02-17T08:28:11.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:28:11.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:28:11.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:28:11.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:646: TEST_ec_recovery_unfound: ceph osd in 2 2026-02-17T08:28:12.202 INFO:tasks.workunit.client.0.trial059.stderr:osd.2 is already in. 2026-02-17T08:28:12.212 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:648: TEST_ec_recovery_unfound: sleep 15 2026-02-17T08:28:27.215 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:650: TEST_ec_recovery_unfound: seq 1 100 2026-02-17T08:28:27.216 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:650: TEST_ec_recovery_unfound: for tmp in $(seq 1 100) 2026-02-17T08:28:27.217 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:651: TEST_ec_recovery_unfound: get_state 2.0 2026-02-17T08:28:27.217 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:60: get_state: local pgid=2.0 2026-02-17T08:28:27.217 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:61: get_state: local sname=state 2026-02-17T08:28:27.218 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:62: get_state: ceph --format json pg dump pgs 2026-02-17T08:28:27.218 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:63: get_state: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .state' 2026-02-17T08:28:27.412 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:651: TEST_ec_recovery_unfound: state=active+recovery_unfound+degraded 2026-02-17T08:28:27.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:652: TEST_ec_recovery_unfound: echo active+recovery_unfound+degraded 2026-02-17T08:28:27.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:652: TEST_ec_recovery_unfound: grep recovery_unfound 2026-02-17T08:28:27.414 INFO:tasks.workunit.client.0.trial059.stdout:active+recovery_unfound+degraded 2026-02-17T08:28:27.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:653: TEST_ec_recovery_unfound: '[' 0 = 0 ']' 2026-02-17T08:28:27.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:654: TEST_ec_recovery_unfound: break 2026-02-17T08:28:27.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:660: TEST_ec_recovery_unfound: ceph pg dump pgs 2026-02-17T08:28:27.609 INFO:tasks.workunit.client.0.trial059.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T08:28:27.609 INFO:tasks.workunit.client.0.trial059.stdout:2.0 101 1 3 0 1 413696 0 0 101 0 101 active+recovery_unfound+degraded 2026-02-17T08:28:12.259274+0000 47'101 53:353 [3,1,4,0,2] 3 [3,1,4,0,2] 3 0'0 2026-02-17T08:27:55.454306+0000 0'0 2026-02-17T08:27:55.454306+0000 0 0 no scrub is scheduled 0 0 2026-02-17T08:28:27.609 INFO:tasks.workunit.client.0.trial059.stdout:1.3 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:28:12.242945+0000 0'0 53:56 [4,1,2] 4 [4,1,2] 4 0'0 2026-02-17T08:27:08.738834+0000 0'0 2026-02-17T08:27:08.738834+0000 0 0 periodic scrub scheduled @ 2026-02-18T10:07:28.936258+0000 0 0 2026-02-17T08:28:27.609 INFO:tasks.workunit.client.0.trial059.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:27:54.225399+0000 0'0 53:112 [0,4,1] 0 [0,4,1] 0 0'0 2026-02-17T08:27:08.738834+0000 0'0 2026-02-17T08:27:08.738834+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:00:37.386565+0000 0 0 2026-02-17T08:28:27.609 INFO:tasks.workunit.client.0.trial059.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:27:54.225390+0000 0'0 53:41 [4,3,0] 4 [4,3,0] 4 0'0 2026-02-17T08:27:08.738834+0000 0'0 2026-02-17T08:27:08.738834+0000 0 0 periodic scrub scheduled @ 2026-02-18T10:41:05.570301+0000 0 0 2026-02-17T08:28:27.609 INFO:tasks.workunit.client.0.trial059.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T08:28:12.243223+0000 0'0 53:99 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T08:27:08.738834+0000 0'0 2026-02-17T08:27:08.738834+0000 0 0 periodic scrub scheduled @ 2026-02-18T20:17:52.955789+0000 0 0 2026-02-17T08:28:27.609 INFO:tasks.workunit.client.0.trial059.stdout: 2026-02-17T08:28:27.609 INFO:tasks.workunit.client.0.trial059.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T08:28:27.610 INFO:tasks.workunit.client.0.trial059.stderr:dumped pgs 2026-02-17T08:28:27.617 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:661: TEST_ec_recovery_unfound: ceph pg 2.0 list_unfound 2026-02-17T08:28:27.700 INFO:tasks.workunit.client.0.trial059.stdout:{ 2026-02-17T08:28:27.700 INFO:tasks.workunit.client.0.trial059.stdout: "num_missing": 1, 2026-02-17T08:28:27.700 INFO:tasks.workunit.client.0.trial059.stdout: "num_unfound": 1, 2026-02-17T08:28:27.700 INFO:tasks.workunit.client.0.trial059.stdout: "objects": [ 2026-02-17T08:28:27.700 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:28:27.700 INFO:tasks.workunit.client.0.trial059.stdout: "oid": { 2026-02-17T08:28:27.700 INFO:tasks.workunit.client.0.trial059.stdout: "oid": "obj75", 2026-02-17T08:28:27.701 INFO:tasks.workunit.client.0.trial059.stdout: "key": "", 2026-02-17T08:28:27.701 INFO:tasks.workunit.client.0.trial059.stdout: "snapid": -2, 2026-02-17T08:28:27.701 INFO:tasks.workunit.client.0.trial059.stdout: "hash": 3565005477, 2026-02-17T08:28:27.701 INFO:tasks.workunit.client.0.trial059.stdout: "max": 0, 2026-02-17T08:28:27.701 INFO:tasks.workunit.client.0.trial059.stdout: "pool": 2, 2026-02-17T08:28:27.701 INFO:tasks.workunit.client.0.trial059.stdout: "namespace": "" 2026-02-17T08:28:27.701 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.701 INFO:tasks.workunit.client.0.trial059.stdout: "need": "47'76", 2026-02-17T08:28:27.701 INFO:tasks.workunit.client.0.trial059.stdout: "have": "0'0", 2026-02-17T08:28:27.701 INFO:tasks.workunit.client.0.trial059.stdout: "flags": "none", 2026-02-17T08:28:27.701 INFO:tasks.workunit.client.0.trial059.stdout: "clean_regions": "clean_offsets: [], clean_omap: false, new_object: true", 2026-02-17T08:28:27.701 INFO:tasks.workunit.client.0.trial059.stdout: "locations": [ 2026-02-17T08:28:27.702 INFO:tasks.workunit.client.0.trial059.stdout: "0(3)", 2026-02-17T08:28:27.702 INFO:tasks.workunit.client.0.trial059.stdout: "4(2)" 2026-02-17T08:28:27.702 INFO:tasks.workunit.client.0.trial059.stdout: ] 2026-02-17T08:28:27.702 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:28:27.702 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.702 INFO:tasks.workunit.client.0.trial059.stdout: "state": "NotRecovering", 2026-02-17T08:28:27.702 INFO:tasks.workunit.client.0.trial059.stdout: "available_might_have_unfound": true, 2026-02-17T08:28:27.702 INFO:tasks.workunit.client.0.trial059.stdout: "might_have_unfound": [], 2026-02-17T08:28:27.702 INFO:tasks.workunit.client.0.trial059.stdout: "more": false 2026-02-17T08:28:27.702 INFO:tasks.workunit.client.0.trial059.stdout:} 2026-02-17T08:28:27.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:662: TEST_ec_recovery_unfound: ceph pg 2.0 query 2026-02-17T08:28:27.784 INFO:tasks.workunit.client.0.trial059.stdout:{ 2026-02-17T08:28:27.785 INFO:tasks.workunit.client.0.trial059.stdout: "snap_trimq": "[]", 2026-02-17T08:28:27.785 INFO:tasks.workunit.client.0.trial059.stdout: "snap_trimq_len": 0, 2026-02-17T08:28:27.785 INFO:tasks.workunit.client.0.trial059.stdout: "state": "active+recovery_unfound+degraded", 2026-02-17T08:28:27.785 INFO:tasks.workunit.client.0.trial059.stdout: "epoch": 53, 2026-02-17T08:28:27.785 INFO:tasks.workunit.client.0.trial059.stdout: "up": [ 2026-02-17T08:28:27.785 INFO:tasks.workunit.client.0.trial059.stdout: 3, 2026-02-17T08:28:27.785 INFO:tasks.workunit.client.0.trial059.stdout: 1, 2026-02-17T08:28:27.785 INFO:tasks.workunit.client.0.trial059.stdout: 4, 2026-02-17T08:28:27.785 INFO:tasks.workunit.client.0.trial059.stdout: 0, 2026-02-17T08:28:27.785 INFO:tasks.workunit.client.0.trial059.stdout: 2 2026-02-17T08:28:27.786 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.786 INFO:tasks.workunit.client.0.trial059.stdout: "acting": [ 2026-02-17T08:28:27.786 INFO:tasks.workunit.client.0.trial059.stdout: 3, 2026-02-17T08:28:27.786 INFO:tasks.workunit.client.0.trial059.stdout: 1, 2026-02-17T08:28:27.786 INFO:tasks.workunit.client.0.trial059.stdout: 4, 2026-02-17T08:28:27.786 INFO:tasks.workunit.client.0.trial059.stdout: 0, 2026-02-17T08:28:27.786 INFO:tasks.workunit.client.0.trial059.stdout: 2 2026-02-17T08:28:27.786 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.786 INFO:tasks.workunit.client.0.trial059.stdout: "acting_recovery_backfill": [ 2026-02-17T08:28:27.786 INFO:tasks.workunit.client.0.trial059.stdout: "0(3)", 2026-02-17T08:28:27.786 INFO:tasks.workunit.client.0.trial059.stdout: "1(1)", 2026-02-17T08:28:27.786 INFO:tasks.workunit.client.0.trial059.stdout: "2(4)", 2026-02-17T08:28:27.786 INFO:tasks.workunit.client.0.trial059.stdout: "3(0)", 2026-02-17T08:28:27.787 INFO:tasks.workunit.client.0.trial059.stdout: "4(2)" 2026-02-17T08:28:27.787 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.787 INFO:tasks.workunit.client.0.trial059.stdout: "info": { 2026-02-17T08:28:27.787 INFO:tasks.workunit.client.0.trial059.stdout: "pgid": "2.0s0", 2026-02-17T08:28:27.787 INFO:tasks.workunit.client.0.trial059.stdout: "shared": "0", 2026-02-17T08:28:27.787 INFO:tasks.workunit.client.0.trial059.stdout: "last_update": "47'101", 2026-02-17T08:28:27.787 INFO:tasks.workunit.client.0.trial059.stdout: "last_complete": "47'75", 2026-02-17T08:28:27.787 INFO:tasks.workunit.client.0.trial059.stdout: "log_tail": "0'0", 2026-02-17T08:28:27.787 INFO:tasks.workunit.client.0.trial059.stdout: "last_user_version": 101, 2026-02-17T08:28:27.787 INFO:tasks.workunit.client.0.trial059.stdout: "last_backfill": "MAX", 2026-02-17T08:28:27.788 INFO:tasks.workunit.client.0.trial059.stdout: "purged_snaps": [], 2026-02-17T08:28:27.788 INFO:tasks.workunit.client.0.trial059.stdout: "history": { 2026-02-17T08:28:27.788 INFO:tasks.workunit.client.0.trial059.stdout: "epoch_created": 41, 2026-02-17T08:28:27.788 INFO:tasks.workunit.client.0.trial059.stdout: "epoch_pool_created": 41, 2026-02-17T08:28:27.788 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_started": 53, 2026-02-17T08:28:27.788 INFO:tasks.workunit.client.0.trial059.stdout: "last_interval_started": 52, 2026-02-17T08:28:27.788 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_clean": 42, 2026-02-17T08:28:27.788 INFO:tasks.workunit.client.0.trial059.stdout: "last_interval_clean": 41, 2026-02-17T08:28:27.788 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_split": 0, 2026-02-17T08:28:27.789 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_marked_full": 0, 2026-02-17T08:28:27.789 INFO:tasks.workunit.client.0.trial059.stdout: "same_up_since": 52, 2026-02-17T08:28:27.789 INFO:tasks.workunit.client.0.trial059.stdout: "same_interval_since": 52, 2026-02-17T08:28:27.789 INFO:tasks.workunit.client.0.trial059.stdout: "same_primary_since": 41, 2026-02-17T08:28:27.789 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub": "0'0", 2026-02-17T08:28:27.789 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.789 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub": "0'0", 2026-02-17T08:28:27.790 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.790 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.790 INFO:tasks.workunit.client.0.trial059.stdout: "prior_readable_until_ub": 0 2026-02-17T08:28:27.790 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.790 INFO:tasks.workunit.client.0.trial059.stdout: "stats": { 2026-02-17T08:28:27.790 INFO:tasks.workunit.client.0.trial059.stdout: "version": "47'101", 2026-02-17T08:28:27.790 INFO:tasks.workunit.client.0.trial059.stdout: "reported_seq": 354, 2026-02-17T08:28:27.790 INFO:tasks.workunit.client.0.trial059.stdout: "reported_epoch": 53, 2026-02-17T08:28:27.790 INFO:tasks.workunit.client.0.trial059.stdout: "state": "active+recovery_unfound+degraded", 2026-02-17T08:28:27.790 INFO:tasks.workunit.client.0.trial059.stdout: "last_fresh": "2026-02-17T08:28:12.259274+0000", 2026-02-17T08:28:27.790 INFO:tasks.workunit.client.0.trial059.stdout: "last_change": "2026-02-17T08:28:12.259274+0000", 2026-02-17T08:28:27.790 INFO:tasks.workunit.client.0.trial059.stdout: "last_active": "2026-02-17T08:28:12.259274+0000", 2026-02-17T08:28:27.791 INFO:tasks.workunit.client.0.trial059.stdout: "last_peered": "2026-02-17T08:28:12.259274+0000", 2026-02-17T08:28:27.791 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean": "2026-02-17T08:28:01.557648+0000", 2026-02-17T08:28:27.791 INFO:tasks.workunit.client.0.trial059.stdout: "last_became_active": "2026-02-17T08:28:12.243510+0000", 2026-02-17T08:28:27.791 INFO:tasks.workunit.client.0.trial059.stdout: "last_became_peered": "2026-02-17T08:28:12.243510+0000", 2026-02-17T08:28:27.791 INFO:tasks.workunit.client.0.trial059.stdout: "last_unstale": "2026-02-17T08:28:12.259274+0000", 2026-02-17T08:28:27.791 INFO:tasks.workunit.client.0.trial059.stdout: "last_undegraded": "2026-02-17T08:28:12.241011+0000", 2026-02-17T08:28:27.791 INFO:tasks.workunit.client.0.trial059.stdout: "last_fullsized": "2026-02-17T08:28:12.259274+0000", 2026-02-17T08:28:27.791 INFO:tasks.workunit.client.0.trial059.stdout: "mapping_epoch": 52, 2026-02-17T08:28:27.791 INFO:tasks.workunit.client.0.trial059.stdout: "log_start": "0'0", 2026-02-17T08:28:27.791 INFO:tasks.workunit.client.0.trial059.stdout: "ondisk_log_start": "0'0", 2026-02-17T08:28:27.791 INFO:tasks.workunit.client.0.trial059.stdout: "created": 41, 2026-02-17T08:28:27.791 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_clean": 42, 2026-02-17T08:28:27.791 INFO:tasks.workunit.client.0.trial059.stdout: "parent": "0.0", 2026-02-17T08:28:27.791 INFO:tasks.workunit.client.0.trial059.stdout: "parent_split_bits": 0, 2026-02-17T08:28:27.792 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub": "0'0", 2026-02-17T08:28:27.792 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.792 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub": "0'0", 2026-02-17T08:28:27.792 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.792 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.792 INFO:tasks.workunit.client.0.trial059.stdout: "objects_scrubbed": 0, 2026-02-17T08:28:27.792 INFO:tasks.workunit.client.0.trial059.stdout: "log_size": 101, 2026-02-17T08:28:27.792 INFO:tasks.workunit.client.0.trial059.stdout: "log_dups_size": 0, 2026-02-17T08:28:27.792 INFO:tasks.workunit.client.0.trial059.stdout: "ondisk_log_size": 101, 2026-02-17T08:28:27.792 INFO:tasks.workunit.client.0.trial059.stdout: "stats_invalid": false, 2026-02-17T08:28:27.792 INFO:tasks.workunit.client.0.trial059.stdout: "dirty_stats_invalid": false, 2026-02-17T08:28:27.792 INFO:tasks.workunit.client.0.trial059.stdout: "omap_stats_invalid": false, 2026-02-17T08:28:27.792 INFO:tasks.workunit.client.0.trial059.stdout: "hitset_stats_invalid": false, 2026-02-17T08:28:27.793 INFO:tasks.workunit.client.0.trial059.stdout: "hitset_bytes_stats_invalid": false, 2026-02-17T08:28:27.793 INFO:tasks.workunit.client.0.trial059.stdout: "pin_stats_invalid": false, 2026-02-17T08:28:27.793 INFO:tasks.workunit.client.0.trial059.stdout: "manifest_stats_invalid": false, 2026-02-17T08:28:27.793 INFO:tasks.workunit.client.0.trial059.stdout: "snaptrimq_len": 0, 2026-02-17T08:28:27.793 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_duration": 0, 2026-02-17T08:28:27.793 INFO:tasks.workunit.client.0.trial059.stdout: "scrub_schedule": "no scrub is scheduled", 2026-02-17T08:28:27.793 INFO:tasks.workunit.client.0.trial059.stdout: "scrub_duration": 0, 2026-02-17T08:28:27.793 INFO:tasks.workunit.client.0.trial059.stdout: "objects_trimmed": 0, 2026-02-17T08:28:27.793 INFO:tasks.workunit.client.0.trial059.stdout: "snaptrim_duration": 0, 2026-02-17T08:28:27.793 INFO:tasks.workunit.client.0.trial059.stdout: "stat_sum": { 2026-02-17T08:28:27.793 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes": 413696, 2026-02-17T08:28:27.793 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects": 101, 2026-02-17T08:28:27.793 INFO:tasks.workunit.client.0.trial059.stdout: "num_object_clones": 0, 2026-02-17T08:28:27.794 INFO:tasks.workunit.client.0.trial059.stdout: "num_object_copies": 505, 2026-02-17T08:28:27.794 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_missing_on_primary": 1, 2026-02-17T08:28:27.794 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_missing": 1, 2026-02-17T08:28:27.794 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_degraded": 3, 2026-02-17T08:28:27.794 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_misplaced": 0, 2026-02-17T08:28:27.794 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_unfound": 1, 2026-02-17T08:28:27.794 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_dirty": 101, 2026-02-17T08:28:27.794 INFO:tasks.workunit.client.0.trial059.stdout: "num_whiteouts": 0, 2026-02-17T08:28:27.794 INFO:tasks.workunit.client.0.trial059.stdout: "num_read": 0, 2026-02-17T08:28:27.794 INFO:tasks.workunit.client.0.trial059.stdout: "num_read_kb": 0, 2026-02-17T08:28:27.794 INFO:tasks.workunit.client.0.trial059.stdout: "num_write": 101, 2026-02-17T08:28:27.794 INFO:tasks.workunit.client.0.trial059.stdout: "num_write_kb": 404, 2026-02-17T08:28:27.794 INFO:tasks.workunit.client.0.trial059.stdout: "num_scrub_errors": 0, 2026-02-17T08:28:27.795 INFO:tasks.workunit.client.0.trial059.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T08:28:27.795 INFO:tasks.workunit.client.0.trial059.stdout: "num_deep_scrub_errors": 0, 2026-02-17T08:28:27.795 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_recovered": 11, 2026-02-17T08:28:27.795 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes_recovered": 45056, 2026-02-17T08:28:27.795 INFO:tasks.workunit.client.0.trial059.stdout: "num_keys_recovered": 0, 2026-02-17T08:28:27.795 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_omap": 0, 2026-02-17T08:28:27.795 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T08:28:27.795 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T08:28:27.795 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush": 0, 2026-02-17T08:28:27.795 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_kb": 0, 2026-02-17T08:28:27.795 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict": 0, 2026-02-17T08:28:27.795 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_kb": 0, 2026-02-17T08:28:27.795 INFO:tasks.workunit.client.0.trial059.stdout: "num_promote": 0, 2026-02-17T08:28:27.796 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_mode_high": 0, 2026-02-17T08:28:27.796 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_mode_low": 0, 2026-02-17T08:28:27.796 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_mode_some": 0, 2026-02-17T08:28:27.796 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_mode_full": 0, 2026-02-17T08:28:27.796 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_pinned": 0, 2026-02-17T08:28:27.796 INFO:tasks.workunit.client.0.trial059.stdout: "num_legacy_snapsets": 0, 2026-02-17T08:28:27.796 INFO:tasks.workunit.client.0.trial059.stdout: "num_large_omap_objects": 0, 2026-02-17T08:28:27.796 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_manifest": 0, 2026-02-17T08:28:27.796 INFO:tasks.workunit.client.0.trial059.stdout: "num_omap_bytes": 0, 2026-02-17T08:28:27.796 INFO:tasks.workunit.client.0.trial059.stdout: "num_omap_keys": 0, 2026-02-17T08:28:27.796 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_repaired": 0 2026-02-17T08:28:27.796 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.796 INFO:tasks.workunit.client.0.trial059.stdout: "up": [ 2026-02-17T08:28:27.796 INFO:tasks.workunit.client.0.trial059.stdout: 3, 2026-02-17T08:28:27.797 INFO:tasks.workunit.client.0.trial059.stdout: 1, 2026-02-17T08:28:27.797 INFO:tasks.workunit.client.0.trial059.stdout: 4, 2026-02-17T08:28:27.797 INFO:tasks.workunit.client.0.trial059.stdout: 0, 2026-02-17T08:28:27.797 INFO:tasks.workunit.client.0.trial059.stdout: 2 2026-02-17T08:28:27.797 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.797 INFO:tasks.workunit.client.0.trial059.stdout: "acting": [ 2026-02-17T08:28:27.797 INFO:tasks.workunit.client.0.trial059.stdout: 3, 2026-02-17T08:28:27.797 INFO:tasks.workunit.client.0.trial059.stdout: 1, 2026-02-17T08:28:27.797 INFO:tasks.workunit.client.0.trial059.stdout: 4, 2026-02-17T08:28:27.797 INFO:tasks.workunit.client.0.trial059.stdout: 0, 2026-02-17T08:28:27.797 INFO:tasks.workunit.client.0.trial059.stdout: 2 2026-02-17T08:28:27.797 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.797 INFO:tasks.workunit.client.0.trial059.stdout: "avail_no_missing": [ 2026-02-17T08:28:27.798 INFO:tasks.workunit.client.0.trial059.stdout: "0(3)", 2026-02-17T08:28:27.798 INFO:tasks.workunit.client.0.trial059.stdout: "4(2)" 2026-02-17T08:28:27.798 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.798 INFO:tasks.workunit.client.0.trial059.stdout: "object_location_counts": [ 2026-02-17T08:28:27.798 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:28:27.798 INFO:tasks.workunit.client.0.trial059.stdout: "shards": "0(3),1(1),2(4),3(0),4(2)", 2026-02-17T08:28:27.798 INFO:tasks.workunit.client.0.trial059.stdout: "objects": 100 2026-02-17T08:28:27.798 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.798 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:28:27.798 INFO:tasks.workunit.client.0.trial059.stdout: "shards": "0(3),4(2)", 2026-02-17T08:28:27.798 INFO:tasks.workunit.client.0.trial059.stdout: "objects": 1 2026-02-17T08:28:27.798 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:28:27.799 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.799 INFO:tasks.workunit.client.0.trial059.stdout: "blocked_by": [], 2026-02-17T08:28:27.799 INFO:tasks.workunit.client.0.trial059.stdout: "up_primary": 3, 2026-02-17T08:28:27.799 INFO:tasks.workunit.client.0.trial059.stdout: "acting_primary": 3, 2026-02-17T08:28:27.799 INFO:tasks.workunit.client.0.trial059.stdout: "purged_snaps": [] 2026-02-17T08:28:27.799 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.799 INFO:tasks.workunit.client.0.trial059.stdout: "empty": 0, 2026-02-17T08:28:27.799 INFO:tasks.workunit.client.0.trial059.stdout: "dne": 0, 2026-02-17T08:28:27.799 INFO:tasks.workunit.client.0.trial059.stdout: "incomplete": 0, 2026-02-17T08:28:27.799 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_started": 53, 2026-02-17T08:28:27.799 INFO:tasks.workunit.client.0.trial059.stdout: "hit_set_history": { 2026-02-17T08:28:27.799 INFO:tasks.workunit.client.0.trial059.stdout: "current_last_update": "0'0", 2026-02-17T08:28:27.799 INFO:tasks.workunit.client.0.trial059.stdout: "history": [] 2026-02-17T08:28:27.800 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:28:27.800 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.800 INFO:tasks.workunit.client.0.trial059.stdout: "peer_info": [ 2026-02-17T08:28:27.800 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:28:27.800 INFO:tasks.workunit.client.0.trial059.stdout: "peer": "0(3)", 2026-02-17T08:28:27.800 INFO:tasks.workunit.client.0.trial059.stdout: "pgid": "2.0s3", 2026-02-17T08:28:27.800 INFO:tasks.workunit.client.0.trial059.stdout: "shared": "3", 2026-02-17T08:28:27.800 INFO:tasks.workunit.client.0.trial059.stdout: "last_update": "47'101", 2026-02-17T08:28:27.800 INFO:tasks.workunit.client.0.trial059.stdout: "last_complete": "47'101", 2026-02-17T08:28:27.800 INFO:tasks.workunit.client.0.trial059.stdout: "log_tail": "0'0", 2026-02-17T08:28:27.800 INFO:tasks.workunit.client.0.trial059.stdout: "last_user_version": 101, 2026-02-17T08:28:27.800 INFO:tasks.workunit.client.0.trial059.stdout: "last_backfill": "MAX", 2026-02-17T08:28:27.800 INFO:tasks.workunit.client.0.trial059.stdout: "purged_snaps": [], 2026-02-17T08:28:27.801 INFO:tasks.workunit.client.0.trial059.stdout: "history": { 2026-02-17T08:28:27.801 INFO:tasks.workunit.client.0.trial059.stdout: "epoch_created": 41, 2026-02-17T08:28:27.801 INFO:tasks.workunit.client.0.trial059.stdout: "epoch_pool_created": 41, 2026-02-17T08:28:27.801 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_started": 53, 2026-02-17T08:28:27.801 INFO:tasks.workunit.client.0.trial059.stdout: "last_interval_started": 52, 2026-02-17T08:28:27.801 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_clean": 42, 2026-02-17T08:28:27.801 INFO:tasks.workunit.client.0.trial059.stdout: "last_interval_clean": 41, 2026-02-17T08:28:27.801 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_split": 0, 2026-02-17T08:28:27.801 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_marked_full": 0, 2026-02-17T08:28:27.801 INFO:tasks.workunit.client.0.trial059.stdout: "same_up_since": 52, 2026-02-17T08:28:27.801 INFO:tasks.workunit.client.0.trial059.stdout: "same_interval_since": 52, 2026-02-17T08:28:27.801 INFO:tasks.workunit.client.0.trial059.stdout: "same_primary_since": 41, 2026-02-17T08:28:27.801 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub": "0'0", 2026-02-17T08:28:27.801 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.802 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub": "0'0", 2026-02-17T08:28:27.802 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.802 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.802 INFO:tasks.workunit.client.0.trial059.stdout: "prior_readable_until_ub": 0 2026-02-17T08:28:27.802 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.802 INFO:tasks.workunit.client.0.trial059.stdout: "stats": { 2026-02-17T08:28:27.802 INFO:tasks.workunit.client.0.trial059.stdout: "version": "47'101", 2026-02-17T08:28:27.802 INFO:tasks.workunit.client.0.trial059.stdout: "reported_seq": 320, 2026-02-17T08:28:27.802 INFO:tasks.workunit.client.0.trial059.stdout: "reported_epoch": 52, 2026-02-17T08:28:27.802 INFO:tasks.workunit.client.0.trial059.stdout: "state": "active+undersized+degraded", 2026-02-17T08:28:27.802 INFO:tasks.workunit.client.0.trial059.stdout: "last_fresh": "2026-02-17T08:28:06.104098+0000", 2026-02-17T08:28:27.802 INFO:tasks.workunit.client.0.trial059.stdout: "last_change": "2026-02-17T08:28:01.914350+0000", 2026-02-17T08:28:27.803 INFO:tasks.workunit.client.0.trial059.stdout: "last_active": "2026-02-17T08:28:06.104098+0000", 2026-02-17T08:28:27.803 INFO:tasks.workunit.client.0.trial059.stdout: "last_peered": "2026-02-17T08:28:06.104098+0000", 2026-02-17T08:28:27.803 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean": "2026-02-17T08:28:01.557648+0000", 2026-02-17T08:28:27.803 INFO:tasks.workunit.client.0.trial059.stdout: "last_became_active": "2026-02-17T08:28:01.914350+0000", 2026-02-17T08:28:27.803 INFO:tasks.workunit.client.0.trial059.stdout: "last_became_peered": "2026-02-17T08:28:01.914350+0000", 2026-02-17T08:28:27.803 INFO:tasks.workunit.client.0.trial059.stdout: "last_unstale": "2026-02-17T08:28:06.104098+0000", 2026-02-17T08:28:27.803 INFO:tasks.workunit.client.0.trial059.stdout: "last_undegraded": "2026-02-17T08:28:01.912442+0000", 2026-02-17T08:28:27.803 INFO:tasks.workunit.client.0.trial059.stdout: "last_fullsized": "2026-02-17T08:28:01.912343+0000", 2026-02-17T08:28:27.803 INFO:tasks.workunit.client.0.trial059.stdout: "mapping_epoch": 52, 2026-02-17T08:28:27.803 INFO:tasks.workunit.client.0.trial059.stdout: "log_start": "0'0", 2026-02-17T08:28:27.803 INFO:tasks.workunit.client.0.trial059.stdout: "ondisk_log_start": "0'0", 2026-02-17T08:28:27.803 INFO:tasks.workunit.client.0.trial059.stdout: "created": 41, 2026-02-17T08:28:27.803 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_clean": 42, 2026-02-17T08:28:27.804 INFO:tasks.workunit.client.0.trial059.stdout: "parent": "0.0", 2026-02-17T08:28:27.804 INFO:tasks.workunit.client.0.trial059.stdout: "parent_split_bits": 0, 2026-02-17T08:28:27.804 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub": "0'0", 2026-02-17T08:28:27.804 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.804 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub": "0'0", 2026-02-17T08:28:27.804 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.804 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.804 INFO:tasks.workunit.client.0.trial059.stdout: "objects_scrubbed": 0, 2026-02-17T08:28:27.804 INFO:tasks.workunit.client.0.trial059.stdout: "log_size": 101, 2026-02-17T08:28:27.804 INFO:tasks.workunit.client.0.trial059.stdout: "log_dups_size": 0, 2026-02-17T08:28:27.804 INFO:tasks.workunit.client.0.trial059.stdout: "ondisk_log_size": 101, 2026-02-17T08:28:27.804 INFO:tasks.workunit.client.0.trial059.stdout: "stats_invalid": false, 2026-02-17T08:28:27.804 INFO:tasks.workunit.client.0.trial059.stdout: "dirty_stats_invalid": false, 2026-02-17T08:28:27.805 INFO:tasks.workunit.client.0.trial059.stdout: "omap_stats_invalid": false, 2026-02-17T08:28:27.805 INFO:tasks.workunit.client.0.trial059.stdout: "hitset_stats_invalid": false, 2026-02-17T08:28:27.805 INFO:tasks.workunit.client.0.trial059.stdout: "hitset_bytes_stats_invalid": false, 2026-02-17T08:28:27.805 INFO:tasks.workunit.client.0.trial059.stdout: "pin_stats_invalid": false, 2026-02-17T08:28:27.805 INFO:tasks.workunit.client.0.trial059.stdout: "manifest_stats_invalid": false, 2026-02-17T08:28:27.805 INFO:tasks.workunit.client.0.trial059.stdout: "snaptrimq_len": 0, 2026-02-17T08:28:27.805 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_duration": 0, 2026-02-17T08:28:27.805 INFO:tasks.workunit.client.0.trial059.stdout: "scrub_schedule": "periodic scrub scheduled @ 2026-02-18T12:10:50.694035+0000", 2026-02-17T08:28:27.805 INFO:tasks.workunit.client.0.trial059.stdout: "scrub_duration": 0, 2026-02-17T08:28:27.805 INFO:tasks.workunit.client.0.trial059.stdout: "objects_trimmed": 0, 2026-02-17T08:28:27.805 INFO:tasks.workunit.client.0.trial059.stdout: "snaptrim_duration": 0, 2026-02-17T08:28:27.805 INFO:tasks.workunit.client.0.trial059.stdout: "stat_sum": { 2026-02-17T08:28:27.805 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes": 413696, 2026-02-17T08:28:27.806 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects": 101, 2026-02-17T08:28:27.806 INFO:tasks.workunit.client.0.trial059.stdout: "num_object_clones": 0, 2026-02-17T08:28:27.806 INFO:tasks.workunit.client.0.trial059.stdout: "num_object_copies": 505, 2026-02-17T08:28:27.806 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T08:28:27.806 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_missing": 0, 2026-02-17T08:28:27.806 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_degraded": 101, 2026-02-17T08:28:27.806 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_misplaced": 0, 2026-02-17T08:28:27.806 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_unfound": 0, 2026-02-17T08:28:27.806 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_dirty": 101, 2026-02-17T08:28:27.806 INFO:tasks.workunit.client.0.trial059.stdout: "num_whiteouts": 0, 2026-02-17T08:28:27.806 INFO:tasks.workunit.client.0.trial059.stdout: "num_read": 0, 2026-02-17T08:28:27.806 INFO:tasks.workunit.client.0.trial059.stdout: "num_read_kb": 0, 2026-02-17T08:28:27.806 INFO:tasks.workunit.client.0.trial059.stdout: "num_write": 101, 2026-02-17T08:28:27.807 INFO:tasks.workunit.client.0.trial059.stdout: "num_write_kb": 404, 2026-02-17T08:28:27.807 INFO:tasks.workunit.client.0.trial059.stdout: "num_scrub_errors": 0, 2026-02-17T08:28:27.807 INFO:tasks.workunit.client.0.trial059.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T08:28:27.807 INFO:tasks.workunit.client.0.trial059.stdout: "num_deep_scrub_errors": 0, 2026-02-17T08:28:27.807 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_recovered": 0, 2026-02-17T08:28:27.807 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes_recovered": 0, 2026-02-17T08:28:27.807 INFO:tasks.workunit.client.0.trial059.stdout: "num_keys_recovered": 0, 2026-02-17T08:28:27.807 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_omap": 0, 2026-02-17T08:28:27.807 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T08:28:27.807 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T08:28:27.807 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush": 0, 2026-02-17T08:28:27.807 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_kb": 0, 2026-02-17T08:28:27.807 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict": 0, 2026-02-17T08:28:27.807 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_kb": 0, 2026-02-17T08:28:27.808 INFO:tasks.workunit.client.0.trial059.stdout: "num_promote": 0, 2026-02-17T08:28:27.808 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_mode_high": 0, 2026-02-17T08:28:27.808 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_mode_low": 0, 2026-02-17T08:28:27.808 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_mode_some": 0, 2026-02-17T08:28:27.808 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_mode_full": 0, 2026-02-17T08:28:27.808 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_pinned": 0, 2026-02-17T08:28:27.808 INFO:tasks.workunit.client.0.trial059.stdout: "num_legacy_snapsets": 0, 2026-02-17T08:28:27.808 INFO:tasks.workunit.client.0.trial059.stdout: "num_large_omap_objects": 0, 2026-02-17T08:28:27.808 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_manifest": 0, 2026-02-17T08:28:27.808 INFO:tasks.workunit.client.0.trial059.stdout: "num_omap_bytes": 0, 2026-02-17T08:28:27.808 INFO:tasks.workunit.client.0.trial059.stdout: "num_omap_keys": 0, 2026-02-17T08:28:27.808 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_repaired": 0 2026-02-17T08:28:27.809 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.809 INFO:tasks.workunit.client.0.trial059.stdout: "up": [ 2026-02-17T08:28:27.809 INFO:tasks.workunit.client.0.trial059.stdout: 3, 2026-02-17T08:28:27.809 INFO:tasks.workunit.client.0.trial059.stdout: 1, 2026-02-17T08:28:27.809 INFO:tasks.workunit.client.0.trial059.stdout: 4, 2026-02-17T08:28:27.809 INFO:tasks.workunit.client.0.trial059.stdout: 0, 2026-02-17T08:28:27.809 INFO:tasks.workunit.client.0.trial059.stdout: 2 2026-02-17T08:28:27.809 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.809 INFO:tasks.workunit.client.0.trial059.stdout: "acting": [ 2026-02-17T08:28:27.809 INFO:tasks.workunit.client.0.trial059.stdout: 3, 2026-02-17T08:28:27.809 INFO:tasks.workunit.client.0.trial059.stdout: 1, 2026-02-17T08:28:27.809 INFO:tasks.workunit.client.0.trial059.stdout: 4, 2026-02-17T08:28:27.810 INFO:tasks.workunit.client.0.trial059.stdout: 0, 2026-02-17T08:28:27.810 INFO:tasks.workunit.client.0.trial059.stdout: 2 2026-02-17T08:28:27.810 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.810 INFO:tasks.workunit.client.0.trial059.stdout: "avail_no_missing": [ 2026-02-17T08:28:27.810 INFO:tasks.workunit.client.0.trial059.stdout: "3(0)", 2026-02-17T08:28:27.810 INFO:tasks.workunit.client.0.trial059.stdout: "0(3)", 2026-02-17T08:28:27.810 INFO:tasks.workunit.client.0.trial059.stdout: "1(1)", 2026-02-17T08:28:27.810 INFO:tasks.workunit.client.0.trial059.stdout: "4(2)" 2026-02-17T08:28:27.810 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.810 INFO:tasks.workunit.client.0.trial059.stdout: "object_location_counts": [ 2026-02-17T08:28:27.810 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:28:27.810 INFO:tasks.workunit.client.0.trial059.stdout: "shards": "0(3),1(1),3(0),4(2)", 2026-02-17T08:28:27.810 INFO:tasks.workunit.client.0.trial059.stdout: "objects": 101 2026-02-17T08:28:27.811 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:28:27.811 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.811 INFO:tasks.workunit.client.0.trial059.stdout: "blocked_by": [], 2026-02-17T08:28:27.811 INFO:tasks.workunit.client.0.trial059.stdout: "up_primary": 3, 2026-02-17T08:28:27.811 INFO:tasks.workunit.client.0.trial059.stdout: "acting_primary": 3, 2026-02-17T08:28:27.811 INFO:tasks.workunit.client.0.trial059.stdout: "purged_snaps": [] 2026-02-17T08:28:27.811 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.811 INFO:tasks.workunit.client.0.trial059.stdout: "empty": 0, 2026-02-17T08:28:27.811 INFO:tasks.workunit.client.0.trial059.stdout: "dne": 0, 2026-02-17T08:28:27.811 INFO:tasks.workunit.client.0.trial059.stdout: "incomplete": 0, 2026-02-17T08:28:27.811 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_started": 53, 2026-02-17T08:28:27.811 INFO:tasks.workunit.client.0.trial059.stdout: "hit_set_history": { 2026-02-17T08:28:27.812 INFO:tasks.workunit.client.0.trial059.stdout: "current_last_update": "0'0", 2026-02-17T08:28:27.812 INFO:tasks.workunit.client.0.trial059.stdout: "history": [] 2026-02-17T08:28:27.812 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:28:27.812 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.812 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:28:27.812 INFO:tasks.workunit.client.0.trial059.stdout: "peer": "1(1)", 2026-02-17T08:28:27.812 INFO:tasks.workunit.client.0.trial059.stdout: "pgid": "2.0s1", 2026-02-17T08:28:27.812 INFO:tasks.workunit.client.0.trial059.stdout: "shared": "1", 2026-02-17T08:28:27.812 INFO:tasks.workunit.client.0.trial059.stdout: "last_update": "47'101", 2026-02-17T08:28:27.812 INFO:tasks.workunit.client.0.trial059.stdout: "last_complete": "47'101", 2026-02-17T08:28:27.812 INFO:tasks.workunit.client.0.trial059.stdout: "log_tail": "0'0", 2026-02-17T08:28:27.812 INFO:tasks.workunit.client.0.trial059.stdout: "last_user_version": 101, 2026-02-17T08:28:27.813 INFO:tasks.workunit.client.0.trial059.stdout: "last_backfill": "MAX", 2026-02-17T08:28:27.813 INFO:tasks.workunit.client.0.trial059.stdout: "purged_snaps": [], 2026-02-17T08:28:27.813 INFO:tasks.workunit.client.0.trial059.stdout: "history": { 2026-02-17T08:28:27.813 INFO:tasks.workunit.client.0.trial059.stdout: "epoch_created": 41, 2026-02-17T08:28:27.813 INFO:tasks.workunit.client.0.trial059.stdout: "epoch_pool_created": 41, 2026-02-17T08:28:27.813 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_started": 53, 2026-02-17T08:28:27.813 INFO:tasks.workunit.client.0.trial059.stdout: "last_interval_started": 52, 2026-02-17T08:28:27.813 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_clean": 42, 2026-02-17T08:28:27.813 INFO:tasks.workunit.client.0.trial059.stdout: "last_interval_clean": 41, 2026-02-17T08:28:27.813 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_split": 0, 2026-02-17T08:28:27.813 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_marked_full": 0, 2026-02-17T08:28:27.813 INFO:tasks.workunit.client.0.trial059.stdout: "same_up_since": 52, 2026-02-17T08:28:27.813 INFO:tasks.workunit.client.0.trial059.stdout: "same_interval_since": 52, 2026-02-17T08:28:27.814 INFO:tasks.workunit.client.0.trial059.stdout: "same_primary_since": 41, 2026-02-17T08:28:27.814 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub": "0'0", 2026-02-17T08:28:27.814 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.814 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub": "0'0", 2026-02-17T08:28:27.814 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.814 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.814 INFO:tasks.workunit.client.0.trial059.stdout: "prior_readable_until_ub": 0 2026-02-17T08:28:27.814 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.814 INFO:tasks.workunit.client.0.trial059.stdout: "stats": { 2026-02-17T08:28:27.814 INFO:tasks.workunit.client.0.trial059.stdout: "version": "47'101", 2026-02-17T08:28:27.814 INFO:tasks.workunit.client.0.trial059.stdout: "reported_seq": 129, 2026-02-17T08:28:27.815 INFO:tasks.workunit.client.0.trial059.stdout: "reported_epoch": 47, 2026-02-17T08:28:27.815 INFO:tasks.workunit.client.0.trial059.stdout: "state": "active+undersized+degraded", 2026-02-17T08:28:27.815 INFO:tasks.workunit.client.0.trial059.stdout: "last_fresh": "2026-02-17T08:28:06.104098+0000", 2026-02-17T08:28:27.815 INFO:tasks.workunit.client.0.trial059.stdout: "last_change": "2026-02-17T08:28:01.914350+0000", 2026-02-17T08:28:27.815 INFO:tasks.workunit.client.0.trial059.stdout: "last_active": "2026-02-17T08:28:06.104098+0000", 2026-02-17T08:28:27.815 INFO:tasks.workunit.client.0.trial059.stdout: "last_peered": "2026-02-17T08:28:06.104098+0000", 2026-02-17T08:28:27.815 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean": "2026-02-17T08:28:01.557648+0000", 2026-02-17T08:28:27.815 INFO:tasks.workunit.client.0.trial059.stdout: "last_became_active": "2026-02-17T08:28:01.914350+0000", 2026-02-17T08:28:27.815 INFO:tasks.workunit.client.0.trial059.stdout: "last_became_peered": "2026-02-17T08:28:01.914350+0000", 2026-02-17T08:28:27.815 INFO:tasks.workunit.client.0.trial059.stdout: "last_unstale": "2026-02-17T08:28:06.104098+0000", 2026-02-17T08:28:27.815 INFO:tasks.workunit.client.0.trial059.stdout: "last_undegraded": "2026-02-17T08:28:01.912442+0000", 2026-02-17T08:28:27.815 INFO:tasks.workunit.client.0.trial059.stdout: "last_fullsized": "2026-02-17T08:28:01.912343+0000", 2026-02-17T08:28:27.816 INFO:tasks.workunit.client.0.trial059.stdout: "mapping_epoch": 52, 2026-02-17T08:28:27.816 INFO:tasks.workunit.client.0.trial059.stdout: "log_start": "0'0", 2026-02-17T08:28:27.816 INFO:tasks.workunit.client.0.trial059.stdout: "ondisk_log_start": "0'0", 2026-02-17T08:28:27.816 INFO:tasks.workunit.client.0.trial059.stdout: "created": 41, 2026-02-17T08:28:27.816 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_clean": 42, 2026-02-17T08:28:27.816 INFO:tasks.workunit.client.0.trial059.stdout: "parent": "0.0", 2026-02-17T08:28:27.816 INFO:tasks.workunit.client.0.trial059.stdout: "parent_split_bits": 0, 2026-02-17T08:28:27.816 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub": "0'0", 2026-02-17T08:28:27.816 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.816 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub": "0'0", 2026-02-17T08:28:27.816 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.816 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.817 INFO:tasks.workunit.client.0.trial059.stdout: "objects_scrubbed": 0, 2026-02-17T08:28:27.817 INFO:tasks.workunit.client.0.trial059.stdout: "log_size": 101, 2026-02-17T08:28:27.817 INFO:tasks.workunit.client.0.trial059.stdout: "log_dups_size": 0, 2026-02-17T08:28:27.817 INFO:tasks.workunit.client.0.trial059.stdout: "ondisk_log_size": 101, 2026-02-17T08:28:27.817 INFO:tasks.workunit.client.0.trial059.stdout: "stats_invalid": false, 2026-02-17T08:28:27.817 INFO:tasks.workunit.client.0.trial059.stdout: "dirty_stats_invalid": false, 2026-02-17T08:28:27.817 INFO:tasks.workunit.client.0.trial059.stdout: "omap_stats_invalid": false, 2026-02-17T08:28:27.817 INFO:tasks.workunit.client.0.trial059.stdout: "hitset_stats_invalid": false, 2026-02-17T08:28:27.817 INFO:tasks.workunit.client.0.trial059.stdout: "hitset_bytes_stats_invalid": false, 2026-02-17T08:28:27.817 INFO:tasks.workunit.client.0.trial059.stdout: "pin_stats_invalid": false, 2026-02-17T08:28:27.817 INFO:tasks.workunit.client.0.trial059.stdout: "manifest_stats_invalid": false, 2026-02-17T08:28:27.817 INFO:tasks.workunit.client.0.trial059.stdout: "snaptrimq_len": 0, 2026-02-17T08:28:27.817 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_duration": 0, 2026-02-17T08:28:27.817 INFO:tasks.workunit.client.0.trial059.stdout: "scrub_schedule": "periodic scrub scheduled @ 2026-02-18T12:10:50.694035+0000", 2026-02-17T08:28:27.818 INFO:tasks.workunit.client.0.trial059.stdout: "scrub_duration": 0, 2026-02-17T08:28:27.818 INFO:tasks.workunit.client.0.trial059.stdout: "objects_trimmed": 0, 2026-02-17T08:28:27.818 INFO:tasks.workunit.client.0.trial059.stdout: "snaptrim_duration": 0, 2026-02-17T08:28:27.818 INFO:tasks.workunit.client.0.trial059.stdout: "stat_sum": { 2026-02-17T08:28:27.818 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes": 413696, 2026-02-17T08:28:27.818 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects": 101, 2026-02-17T08:28:27.818 INFO:tasks.workunit.client.0.trial059.stdout: "num_object_clones": 0, 2026-02-17T08:28:27.818 INFO:tasks.workunit.client.0.trial059.stdout: "num_object_copies": 505, 2026-02-17T08:28:27.818 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T08:28:27.818 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_missing": 1, 2026-02-17T08:28:27.818 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_degraded": 101, 2026-02-17T08:28:27.818 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_misplaced": 0, 2026-02-17T08:28:27.818 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_unfound": 0, 2026-02-17T08:28:27.818 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_dirty": 101, 2026-02-17T08:28:27.819 INFO:tasks.workunit.client.0.trial059.stdout: "num_whiteouts": 0, 2026-02-17T08:28:27.819 INFO:tasks.workunit.client.0.trial059.stdout: "num_read": 0, 2026-02-17T08:28:27.819 INFO:tasks.workunit.client.0.trial059.stdout: "num_read_kb": 0, 2026-02-17T08:28:27.819 INFO:tasks.workunit.client.0.trial059.stdout: "num_write": 101, 2026-02-17T08:28:27.819 INFO:tasks.workunit.client.0.trial059.stdout: "num_write_kb": 404, 2026-02-17T08:28:27.819 INFO:tasks.workunit.client.0.trial059.stdout: "num_scrub_errors": 0, 2026-02-17T08:28:27.819 INFO:tasks.workunit.client.0.trial059.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T08:28:27.819 INFO:tasks.workunit.client.0.trial059.stdout: "num_deep_scrub_errors": 0, 2026-02-17T08:28:27.819 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_recovered": 0, 2026-02-17T08:28:27.819 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes_recovered": 0, 2026-02-17T08:28:27.819 INFO:tasks.workunit.client.0.trial059.stdout: "num_keys_recovered": 0, 2026-02-17T08:28:27.819 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_omap": 0, 2026-02-17T08:28:27.819 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T08:28:27.819 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T08:28:27.820 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush": 0, 2026-02-17T08:28:27.820 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_kb": 0, 2026-02-17T08:28:27.820 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict": 0, 2026-02-17T08:28:27.820 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_kb": 0, 2026-02-17T08:28:27.820 INFO:tasks.workunit.client.0.trial059.stdout: "num_promote": 0, 2026-02-17T08:28:27.820 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_mode_high": 0, 2026-02-17T08:28:27.820 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_mode_low": 0, 2026-02-17T08:28:27.820 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_mode_some": 0, 2026-02-17T08:28:27.820 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_mode_full": 0, 2026-02-17T08:28:27.820 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_pinned": 0, 2026-02-17T08:28:27.820 INFO:tasks.workunit.client.0.trial059.stdout: "num_legacy_snapsets": 0, 2026-02-17T08:28:27.820 INFO:tasks.workunit.client.0.trial059.stdout: "num_large_omap_objects": 0, 2026-02-17T08:28:27.820 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_manifest": 0, 2026-02-17T08:28:27.820 INFO:tasks.workunit.client.0.trial059.stdout: "num_omap_bytes": 0, 2026-02-17T08:28:27.820 INFO:tasks.workunit.client.0.trial059.stdout: "num_omap_keys": 0, 2026-02-17T08:28:27.821 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_repaired": 0 2026-02-17T08:28:27.821 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.821 INFO:tasks.workunit.client.0.trial059.stdout: "up": [ 2026-02-17T08:28:27.821 INFO:tasks.workunit.client.0.trial059.stdout: 3, 2026-02-17T08:28:27.821 INFO:tasks.workunit.client.0.trial059.stdout: 1, 2026-02-17T08:28:27.821 INFO:tasks.workunit.client.0.trial059.stdout: 4, 2026-02-17T08:28:27.821 INFO:tasks.workunit.client.0.trial059.stdout: 0, 2026-02-17T08:28:27.821 INFO:tasks.workunit.client.0.trial059.stdout: 2 2026-02-17T08:28:27.821 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.821 INFO:tasks.workunit.client.0.trial059.stdout: "acting": [ 2026-02-17T08:28:27.821 INFO:tasks.workunit.client.0.trial059.stdout: 3, 2026-02-17T08:28:27.821 INFO:tasks.workunit.client.0.trial059.stdout: 1, 2026-02-17T08:28:27.821 INFO:tasks.workunit.client.0.trial059.stdout: 4, 2026-02-17T08:28:27.821 INFO:tasks.workunit.client.0.trial059.stdout: 0, 2026-02-17T08:28:27.821 INFO:tasks.workunit.client.0.trial059.stdout: 2 2026-02-17T08:28:27.822 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.822 INFO:tasks.workunit.client.0.trial059.stdout: "avail_no_missing": [ 2026-02-17T08:28:27.822 INFO:tasks.workunit.client.0.trial059.stdout: "3(0)", 2026-02-17T08:28:27.822 INFO:tasks.workunit.client.0.trial059.stdout: "0(3)", 2026-02-17T08:28:27.822 INFO:tasks.workunit.client.0.trial059.stdout: "1(1)", 2026-02-17T08:28:27.822 INFO:tasks.workunit.client.0.trial059.stdout: "4(2)" 2026-02-17T08:28:27.822 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.822 INFO:tasks.workunit.client.0.trial059.stdout: "object_location_counts": [ 2026-02-17T08:28:27.822 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:28:27.822 INFO:tasks.workunit.client.0.trial059.stdout: "shards": "0(3),1(1),3(0),4(2)", 2026-02-17T08:28:27.822 INFO:tasks.workunit.client.0.trial059.stdout: "objects": 101 2026-02-17T08:28:27.822 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:28:27.822 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.822 INFO:tasks.workunit.client.0.trial059.stdout: "blocked_by": [], 2026-02-17T08:28:27.822 INFO:tasks.workunit.client.0.trial059.stdout: "up_primary": 3, 2026-02-17T08:28:27.822 INFO:tasks.workunit.client.0.trial059.stdout: "acting_primary": 3, 2026-02-17T08:28:27.823 INFO:tasks.workunit.client.0.trial059.stdout: "purged_snaps": [] 2026-02-17T08:28:27.823 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.823 INFO:tasks.workunit.client.0.trial059.stdout: "empty": 0, 2026-02-17T08:28:27.823 INFO:tasks.workunit.client.0.trial059.stdout: "dne": 0, 2026-02-17T08:28:27.823 INFO:tasks.workunit.client.0.trial059.stdout: "incomplete": 0, 2026-02-17T08:28:27.823 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_started": 53, 2026-02-17T08:28:27.823 INFO:tasks.workunit.client.0.trial059.stdout: "hit_set_history": { 2026-02-17T08:28:27.823 INFO:tasks.workunit.client.0.trial059.stdout: "current_last_update": "0'0", 2026-02-17T08:28:27.823 INFO:tasks.workunit.client.0.trial059.stdout: "history": [] 2026-02-17T08:28:27.823 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:28:27.823 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.823 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:28:27.823 INFO:tasks.workunit.client.0.trial059.stdout: "peer": "2(4)", 2026-02-17T08:28:27.823 INFO:tasks.workunit.client.0.trial059.stdout: "pgid": "2.0s4", 2026-02-17T08:28:27.823 INFO:tasks.workunit.client.0.trial059.stdout: "shared": "4", 2026-02-17T08:28:27.823 INFO:tasks.workunit.client.0.trial059.stdout: "last_update": "47'101", 2026-02-17T08:28:27.824 INFO:tasks.workunit.client.0.trial059.stdout: "last_complete": "47'75", 2026-02-17T08:28:27.824 INFO:tasks.workunit.client.0.trial059.stdout: "log_tail": "0'0", 2026-02-17T08:28:27.824 INFO:tasks.workunit.client.0.trial059.stdout: "last_user_version": 101, 2026-02-17T08:28:27.824 INFO:tasks.workunit.client.0.trial059.stdout: "last_backfill": "MAX", 2026-02-17T08:28:27.824 INFO:tasks.workunit.client.0.trial059.stdout: "purged_snaps": [], 2026-02-17T08:28:27.824 INFO:tasks.workunit.client.0.trial059.stdout: "history": { 2026-02-17T08:28:27.824 INFO:tasks.workunit.client.0.trial059.stdout: "epoch_created": 41, 2026-02-17T08:28:27.824 INFO:tasks.workunit.client.0.trial059.stdout: "epoch_pool_created": 41, 2026-02-17T08:28:27.824 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_started": 53, 2026-02-17T08:28:27.824 INFO:tasks.workunit.client.0.trial059.stdout: "last_interval_started": 52, 2026-02-17T08:28:27.824 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_clean": 42, 2026-02-17T08:28:27.824 INFO:tasks.workunit.client.0.trial059.stdout: "last_interval_clean": 41, 2026-02-17T08:28:27.824 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_split": 0, 2026-02-17T08:28:27.824 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_marked_full": 0, 2026-02-17T08:28:27.824 INFO:tasks.workunit.client.0.trial059.stdout: "same_up_since": 52, 2026-02-17T08:28:27.824 INFO:tasks.workunit.client.0.trial059.stdout: "same_interval_since": 52, 2026-02-17T08:28:27.825 INFO:tasks.workunit.client.0.trial059.stdout: "same_primary_since": 41, 2026-02-17T08:28:27.825 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub": "0'0", 2026-02-17T08:28:27.825 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.825 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub": "0'0", 2026-02-17T08:28:27.825 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.825 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.825 INFO:tasks.workunit.client.0.trial059.stdout: "prior_readable_until_ub": 0 2026-02-17T08:28:27.825 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.825 INFO:tasks.workunit.client.0.trial059.stdout: "stats": { 2026-02-17T08:28:27.825 INFO:tasks.workunit.client.0.trial059.stdout: "version": "47'101", 2026-02-17T08:28:27.825 INFO:tasks.workunit.client.0.trial059.stdout: "reported_seq": 135, 2026-02-17T08:28:27.825 INFO:tasks.workunit.client.0.trial059.stdout: "reported_epoch": 51, 2026-02-17T08:28:27.825 INFO:tasks.workunit.client.0.trial059.stdout: "state": "remapped+peering", 2026-02-17T08:28:27.825 INFO:tasks.workunit.client.0.trial059.stdout: "last_fresh": "2026-02-17T08:28:12.036440+0000", 2026-02-17T08:28:27.825 INFO:tasks.workunit.client.0.trial059.stdout: "last_change": "2026-02-17T08:28:11.935695+0000", 2026-02-17T08:28:27.825 INFO:tasks.workunit.client.0.trial059.stdout: "last_active": "2026-02-17T08:28:11.935695+0000", 2026-02-17T08:28:27.825 INFO:tasks.workunit.client.0.trial059.stdout: "last_peered": "2026-02-17T08:28:11.882557+0000", 2026-02-17T08:28:27.826 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean": "2026-02-17T08:28:01.557648+0000", 2026-02-17T08:28:27.826 INFO:tasks.workunit.client.0.trial059.stdout: "last_became_active": "2026-02-17T08:28:01.914350+0000", 2026-02-17T08:28:27.826 INFO:tasks.workunit.client.0.trial059.stdout: "last_became_peered": "2026-02-17T08:28:01.914350+0000", 2026-02-17T08:28:27.826 INFO:tasks.workunit.client.0.trial059.stdout: "last_unstale": "2026-02-17T08:28:12.036440+0000", 2026-02-17T08:28:27.826 INFO:tasks.workunit.client.0.trial059.stdout: "last_undegraded": "2026-02-17T08:28:12.036440+0000", 2026-02-17T08:28:27.826 INFO:tasks.workunit.client.0.trial059.stdout: "last_fullsized": "2026-02-17T08:28:12.036440+0000", 2026-02-17T08:28:27.826 INFO:tasks.workunit.client.0.trial059.stdout: "mapping_epoch": 52, 2026-02-17T08:28:27.826 INFO:tasks.workunit.client.0.trial059.stdout: "log_start": "0'0", 2026-02-17T08:28:27.826 INFO:tasks.workunit.client.0.trial059.stdout: "ondisk_log_start": "0'0", 2026-02-17T08:28:27.826 INFO:tasks.workunit.client.0.trial059.stdout: "created": 41, 2026-02-17T08:28:27.826 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_clean": 42, 2026-02-17T08:28:27.826 INFO:tasks.workunit.client.0.trial059.stdout: "parent": "0.0", 2026-02-17T08:28:27.826 INFO:tasks.workunit.client.0.trial059.stdout: "parent_split_bits": 0, 2026-02-17T08:28:27.826 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub": "0'0", 2026-02-17T08:28:27.826 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.826 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub": "0'0", 2026-02-17T08:28:27.827 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.827 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.827 INFO:tasks.workunit.client.0.trial059.stdout: "objects_scrubbed": 0, 2026-02-17T08:28:27.827 INFO:tasks.workunit.client.0.trial059.stdout: "log_size": 101, 2026-02-17T08:28:27.827 INFO:tasks.workunit.client.0.trial059.stdout: "log_dups_size": 0, 2026-02-17T08:28:27.827 INFO:tasks.workunit.client.0.trial059.stdout: "ondisk_log_size": 101, 2026-02-17T08:28:27.827 INFO:tasks.workunit.client.0.trial059.stdout: "stats_invalid": false, 2026-02-17T08:28:27.827 INFO:tasks.workunit.client.0.trial059.stdout: "dirty_stats_invalid": false, 2026-02-17T08:28:27.827 INFO:tasks.workunit.client.0.trial059.stdout: "omap_stats_invalid": false, 2026-02-17T08:28:27.827 INFO:tasks.workunit.client.0.trial059.stdout: "hitset_stats_invalid": false, 2026-02-17T08:28:27.827 INFO:tasks.workunit.client.0.trial059.stdout: "hitset_bytes_stats_invalid": false, 2026-02-17T08:28:27.827 INFO:tasks.workunit.client.0.trial059.stdout: "pin_stats_invalid": false, 2026-02-17T08:28:27.827 INFO:tasks.workunit.client.0.trial059.stdout: "manifest_stats_invalid": false, 2026-02-17T08:28:27.827 INFO:tasks.workunit.client.0.trial059.stdout: "snaptrimq_len": 0, 2026-02-17T08:28:27.827 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_duration": 0, 2026-02-17T08:28:27.827 INFO:tasks.workunit.client.0.trial059.stdout: "scrub_schedule": "no scrub is scheduled", 2026-02-17T08:28:27.828 INFO:tasks.workunit.client.0.trial059.stdout: "scrub_duration": 0, 2026-02-17T08:28:27.828 INFO:tasks.workunit.client.0.trial059.stdout: "objects_trimmed": 0, 2026-02-17T08:28:27.828 INFO:tasks.workunit.client.0.trial059.stdout: "snaptrim_duration": 0, 2026-02-17T08:28:27.828 INFO:tasks.workunit.client.0.trial059.stdout: "stat_sum": { 2026-02-17T08:28:27.828 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes": 413696, 2026-02-17T08:28:27.828 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects": 101, 2026-02-17T08:28:27.828 INFO:tasks.workunit.client.0.trial059.stdout: "num_object_clones": 0, 2026-02-17T08:28:27.828 INFO:tasks.workunit.client.0.trial059.stdout: "num_object_copies": 505, 2026-02-17T08:28:27.828 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T08:28:27.828 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_missing": 1, 2026-02-17T08:28:27.828 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_degraded": 0, 2026-02-17T08:28:27.828 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_misplaced": 0, 2026-02-17T08:28:27.828 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_unfound": 0, 2026-02-17T08:28:27.828 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_dirty": 101, 2026-02-17T08:28:27.828 INFO:tasks.workunit.client.0.trial059.stdout: "num_whiteouts": 0, 2026-02-17T08:28:27.828 INFO:tasks.workunit.client.0.trial059.stdout: "num_read": 0, 2026-02-17T08:28:27.828 INFO:tasks.workunit.client.0.trial059.stdout: "num_read_kb": 0, 2026-02-17T08:28:27.828 INFO:tasks.workunit.client.0.trial059.stdout: "num_write": 101, 2026-02-17T08:28:27.828 INFO:tasks.workunit.client.0.trial059.stdout: "num_write_kb": 404, 2026-02-17T08:28:27.829 INFO:tasks.workunit.client.0.trial059.stdout: "num_scrub_errors": 0, 2026-02-17T08:28:27.829 INFO:tasks.workunit.client.0.trial059.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T08:28:27.829 INFO:tasks.workunit.client.0.trial059.stdout: "num_deep_scrub_errors": 0, 2026-02-17T08:28:27.829 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_recovered": 0, 2026-02-17T08:28:27.829 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes_recovered": 0, 2026-02-17T08:28:27.829 INFO:tasks.workunit.client.0.trial059.stdout: "num_keys_recovered": 0, 2026-02-17T08:28:27.829 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_omap": 0, 2026-02-17T08:28:27.829 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T08:28:27.829 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T08:28:27.829 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush": 0, 2026-02-17T08:28:27.829 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_kb": 0, 2026-02-17T08:28:27.829 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict": 0, 2026-02-17T08:28:27.829 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_kb": 0, 2026-02-17T08:28:27.829 INFO:tasks.workunit.client.0.trial059.stdout: "num_promote": 0, 2026-02-17T08:28:27.829 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_mode_high": 0, 2026-02-17T08:28:27.829 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_mode_low": 0, 2026-02-17T08:28:27.829 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_mode_some": 0, 2026-02-17T08:28:27.829 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_mode_full": 0, 2026-02-17T08:28:27.829 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_pinned": 0, 2026-02-17T08:28:27.830 INFO:tasks.workunit.client.0.trial059.stdout: "num_legacy_snapsets": 0, 2026-02-17T08:28:27.830 INFO:tasks.workunit.client.0.trial059.stdout: "num_large_omap_objects": 0, 2026-02-17T08:28:27.830 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_manifest": 0, 2026-02-17T08:28:27.830 INFO:tasks.workunit.client.0.trial059.stdout: "num_omap_bytes": 0, 2026-02-17T08:28:27.830 INFO:tasks.workunit.client.0.trial059.stdout: "num_omap_keys": 0, 2026-02-17T08:28:27.830 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_repaired": 0 2026-02-17T08:28:27.830 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.830 INFO:tasks.workunit.client.0.trial059.stdout: "up": [ 2026-02-17T08:28:27.830 INFO:tasks.workunit.client.0.trial059.stdout: 3, 2026-02-17T08:28:27.830 INFO:tasks.workunit.client.0.trial059.stdout: 1, 2026-02-17T08:28:27.830 INFO:tasks.workunit.client.0.trial059.stdout: 4, 2026-02-17T08:28:27.830 INFO:tasks.workunit.client.0.trial059.stdout: 0, 2026-02-17T08:28:27.830 INFO:tasks.workunit.client.0.trial059.stdout: 2 2026-02-17T08:28:27.830 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.830 INFO:tasks.workunit.client.0.trial059.stdout: "acting": [ 2026-02-17T08:28:27.830 INFO:tasks.workunit.client.0.trial059.stdout: 3, 2026-02-17T08:28:27.830 INFO:tasks.workunit.client.0.trial059.stdout: 1, 2026-02-17T08:28:27.830 INFO:tasks.workunit.client.0.trial059.stdout: 4, 2026-02-17T08:28:27.831 INFO:tasks.workunit.client.0.trial059.stdout: 0, 2026-02-17T08:28:27.831 INFO:tasks.workunit.client.0.trial059.stdout: 2 2026-02-17T08:28:27.831 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.831 INFO:tasks.workunit.client.0.trial059.stdout: "avail_no_missing": [], 2026-02-17T08:28:27.831 INFO:tasks.workunit.client.0.trial059.stdout: "object_location_counts": [], 2026-02-17T08:28:27.831 INFO:tasks.workunit.client.0.trial059.stdout: "blocked_by": [], 2026-02-17T08:28:27.831 INFO:tasks.workunit.client.0.trial059.stdout: "up_primary": 3, 2026-02-17T08:28:27.831 INFO:tasks.workunit.client.0.trial059.stdout: "acting_primary": 3, 2026-02-17T08:28:27.831 INFO:tasks.workunit.client.0.trial059.stdout: "purged_snaps": [] 2026-02-17T08:28:27.831 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.831 INFO:tasks.workunit.client.0.trial059.stdout: "empty": 0, 2026-02-17T08:28:27.831 INFO:tasks.workunit.client.0.trial059.stdout: "dne": 0, 2026-02-17T08:28:27.831 INFO:tasks.workunit.client.0.trial059.stdout: "incomplete": 0, 2026-02-17T08:28:27.831 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_started": 53, 2026-02-17T08:28:27.831 INFO:tasks.workunit.client.0.trial059.stdout: "hit_set_history": { 2026-02-17T08:28:27.831 INFO:tasks.workunit.client.0.trial059.stdout: "current_last_update": "0'0", 2026-02-17T08:28:27.831 INFO:tasks.workunit.client.0.trial059.stdout: "history": [] 2026-02-17T08:28:27.831 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:28:27.831 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.832 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:28:27.832 INFO:tasks.workunit.client.0.trial059.stdout: "peer": "4(2)", 2026-02-17T08:28:27.832 INFO:tasks.workunit.client.0.trial059.stdout: "pgid": "2.0s2", 2026-02-17T08:28:27.832 INFO:tasks.workunit.client.0.trial059.stdout: "shared": "2", 2026-02-17T08:28:27.832 INFO:tasks.workunit.client.0.trial059.stdout: "last_update": "47'101", 2026-02-17T08:28:27.832 INFO:tasks.workunit.client.0.trial059.stdout: "last_complete": "47'101", 2026-02-17T08:28:27.832 INFO:tasks.workunit.client.0.trial059.stdout: "log_tail": "0'0", 2026-02-17T08:28:27.832 INFO:tasks.workunit.client.0.trial059.stdout: "last_user_version": 101, 2026-02-17T08:28:27.832 INFO:tasks.workunit.client.0.trial059.stdout: "last_backfill": "MAX", 2026-02-17T08:28:27.832 INFO:tasks.workunit.client.0.trial059.stdout: "purged_snaps": [], 2026-02-17T08:28:27.832 INFO:tasks.workunit.client.0.trial059.stdout: "history": { 2026-02-17T08:28:27.832 INFO:tasks.workunit.client.0.trial059.stdout: "epoch_created": 41, 2026-02-17T08:28:27.832 INFO:tasks.workunit.client.0.trial059.stdout: "epoch_pool_created": 41, 2026-02-17T08:28:27.832 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_started": 53, 2026-02-17T08:28:27.832 INFO:tasks.workunit.client.0.trial059.stdout: "last_interval_started": 52, 2026-02-17T08:28:27.832 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_clean": 42, 2026-02-17T08:28:27.832 INFO:tasks.workunit.client.0.trial059.stdout: "last_interval_clean": 41, 2026-02-17T08:28:27.832 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_split": 0, 2026-02-17T08:28:27.832 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_marked_full": 0, 2026-02-17T08:28:27.832 INFO:tasks.workunit.client.0.trial059.stdout: "same_up_since": 52, 2026-02-17T08:28:27.833 INFO:tasks.workunit.client.0.trial059.stdout: "same_interval_since": 52, 2026-02-17T08:28:27.833 INFO:tasks.workunit.client.0.trial059.stdout: "same_primary_since": 41, 2026-02-17T08:28:27.833 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub": "0'0", 2026-02-17T08:28:27.833 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.833 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub": "0'0", 2026-02-17T08:28:27.833 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.833 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.833 INFO:tasks.workunit.client.0.trial059.stdout: "prior_readable_until_ub": 0 2026-02-17T08:28:27.833 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.833 INFO:tasks.workunit.client.0.trial059.stdout: "stats": { 2026-02-17T08:28:27.833 INFO:tasks.workunit.client.0.trial059.stdout: "version": "47'101", 2026-02-17T08:28:27.833 INFO:tasks.workunit.client.0.trial059.stdout: "reported_seq": 129, 2026-02-17T08:28:27.833 INFO:tasks.workunit.client.0.trial059.stdout: "reported_epoch": 47, 2026-02-17T08:28:27.833 INFO:tasks.workunit.client.0.trial059.stdout: "state": "active+undersized+degraded", 2026-02-17T08:28:27.833 INFO:tasks.workunit.client.0.trial059.stdout: "last_fresh": "2026-02-17T08:28:06.104098+0000", 2026-02-17T08:28:27.833 INFO:tasks.workunit.client.0.trial059.stdout: "last_change": "2026-02-17T08:28:01.914350+0000", 2026-02-17T08:28:27.833 INFO:tasks.workunit.client.0.trial059.stdout: "last_active": "2026-02-17T08:28:06.104098+0000", 2026-02-17T08:28:27.833 INFO:tasks.workunit.client.0.trial059.stdout: "last_peered": "2026-02-17T08:28:06.104098+0000", 2026-02-17T08:28:27.833 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean": "2026-02-17T08:28:01.557648+0000", 2026-02-17T08:28:27.834 INFO:tasks.workunit.client.0.trial059.stdout: "last_became_active": "2026-02-17T08:28:01.914350+0000", 2026-02-17T08:28:27.834 INFO:tasks.workunit.client.0.trial059.stdout: "last_became_peered": "2026-02-17T08:28:01.914350+0000", 2026-02-17T08:28:27.834 INFO:tasks.workunit.client.0.trial059.stdout: "last_unstale": "2026-02-17T08:28:06.104098+0000", 2026-02-17T08:28:27.834 INFO:tasks.workunit.client.0.trial059.stdout: "last_undegraded": "2026-02-17T08:28:01.912442+0000", 2026-02-17T08:28:27.834 INFO:tasks.workunit.client.0.trial059.stdout: "last_fullsized": "2026-02-17T08:28:01.912343+0000", 2026-02-17T08:28:27.834 INFO:tasks.workunit.client.0.trial059.stdout: "mapping_epoch": 52, 2026-02-17T08:28:27.834 INFO:tasks.workunit.client.0.trial059.stdout: "log_start": "0'0", 2026-02-17T08:28:27.834 INFO:tasks.workunit.client.0.trial059.stdout: "ondisk_log_start": "0'0", 2026-02-17T08:28:27.834 INFO:tasks.workunit.client.0.trial059.stdout: "created": 41, 2026-02-17T08:28:27.834 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_clean": 42, 2026-02-17T08:28:27.834 INFO:tasks.workunit.client.0.trial059.stdout: "parent": "0.0", 2026-02-17T08:28:27.834 INFO:tasks.workunit.client.0.trial059.stdout: "parent_split_bits": 0, 2026-02-17T08:28:27.834 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub": "0'0", 2026-02-17T08:28:27.834 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.834 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub": "0'0", 2026-02-17T08:28:27.834 INFO:tasks.workunit.client.0.trial059.stdout: "last_deep_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.834 INFO:tasks.workunit.client.0.trial059.stdout: "last_clean_scrub_stamp": "2026-02-17T08:27:55.454306+0000", 2026-02-17T08:28:27.834 INFO:tasks.workunit.client.0.trial059.stdout: "objects_scrubbed": 0, 2026-02-17T08:28:27.834 INFO:tasks.workunit.client.0.trial059.stdout: "log_size": 101, 2026-02-17T08:28:27.834 INFO:tasks.workunit.client.0.trial059.stdout: "log_dups_size": 0, 2026-02-17T08:28:27.834 INFO:tasks.workunit.client.0.trial059.stdout: "ondisk_log_size": 101, 2026-02-17T08:28:27.834 INFO:tasks.workunit.client.0.trial059.stdout: "stats_invalid": false, 2026-02-17T08:28:27.835 INFO:tasks.workunit.client.0.trial059.stdout: "dirty_stats_invalid": false, 2026-02-17T08:28:27.835 INFO:tasks.workunit.client.0.trial059.stdout: "omap_stats_invalid": false, 2026-02-17T08:28:27.835 INFO:tasks.workunit.client.0.trial059.stdout: "hitset_stats_invalid": false, 2026-02-17T08:28:27.835 INFO:tasks.workunit.client.0.trial059.stdout: "hitset_bytes_stats_invalid": false, 2026-02-17T08:28:27.835 INFO:tasks.workunit.client.0.trial059.stdout: "pin_stats_invalid": false, 2026-02-17T08:28:27.835 INFO:tasks.workunit.client.0.trial059.stdout: "manifest_stats_invalid": false, 2026-02-17T08:28:27.835 INFO:tasks.workunit.client.0.trial059.stdout: "snaptrimq_len": 0, 2026-02-17T08:28:27.835 INFO:tasks.workunit.client.0.trial059.stdout: "last_scrub_duration": 0, 2026-02-17T08:28:27.835 INFO:tasks.workunit.client.0.trial059.stdout: "scrub_schedule": "periodic scrub scheduled @ 2026-02-18T12:10:50.694035+0000", 2026-02-17T08:28:27.835 INFO:tasks.workunit.client.0.trial059.stdout: "scrub_duration": 0, 2026-02-17T08:28:27.835 INFO:tasks.workunit.client.0.trial059.stdout: "objects_trimmed": 0, 2026-02-17T08:28:27.835 INFO:tasks.workunit.client.0.trial059.stdout: "snaptrim_duration": 0, 2026-02-17T08:28:27.835 INFO:tasks.workunit.client.0.trial059.stdout: "stat_sum": { 2026-02-17T08:28:27.835 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes": 413696, 2026-02-17T08:28:27.835 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects": 101, 2026-02-17T08:28:27.835 INFO:tasks.workunit.client.0.trial059.stdout: "num_object_clones": 0, 2026-02-17T08:28:27.835 INFO:tasks.workunit.client.0.trial059.stdout: "num_object_copies": 505, 2026-02-17T08:28:27.835 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T08:28:27.835 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_missing": 0, 2026-02-17T08:28:27.835 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_degraded": 101, 2026-02-17T08:28:27.835 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_misplaced": 0, 2026-02-17T08:28:27.835 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_unfound": 0, 2026-02-17T08:28:27.836 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_dirty": 101, 2026-02-17T08:28:27.836 INFO:tasks.workunit.client.0.trial059.stdout: "num_whiteouts": 0, 2026-02-17T08:28:27.836 INFO:tasks.workunit.client.0.trial059.stdout: "num_read": 0, 2026-02-17T08:28:27.836 INFO:tasks.workunit.client.0.trial059.stdout: "num_read_kb": 0, 2026-02-17T08:28:27.836 INFO:tasks.workunit.client.0.trial059.stdout: "num_write": 101, 2026-02-17T08:28:27.836 INFO:tasks.workunit.client.0.trial059.stdout: "num_write_kb": 404, 2026-02-17T08:28:27.836 INFO:tasks.workunit.client.0.trial059.stdout: "num_scrub_errors": 0, 2026-02-17T08:28:27.836 INFO:tasks.workunit.client.0.trial059.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T08:28:27.836 INFO:tasks.workunit.client.0.trial059.stdout: "num_deep_scrub_errors": 0, 2026-02-17T08:28:27.836 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_recovered": 0, 2026-02-17T08:28:27.836 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes_recovered": 0, 2026-02-17T08:28:27.836 INFO:tasks.workunit.client.0.trial059.stdout: "num_keys_recovered": 0, 2026-02-17T08:28:27.836 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_omap": 0, 2026-02-17T08:28:27.836 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T08:28:27.836 INFO:tasks.workunit.client.0.trial059.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T08:28:27.836 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush": 0, 2026-02-17T08:28:27.836 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_kb": 0, 2026-02-17T08:28:27.836 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict": 0, 2026-02-17T08:28:27.836 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_kb": 0, 2026-02-17T08:28:27.836 INFO:tasks.workunit.client.0.trial059.stdout: "num_promote": 0, 2026-02-17T08:28:27.836 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_mode_high": 0, 2026-02-17T08:28:27.837 INFO:tasks.workunit.client.0.trial059.stdout: "num_flush_mode_low": 0, 2026-02-17T08:28:27.837 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_mode_some": 0, 2026-02-17T08:28:27.837 INFO:tasks.workunit.client.0.trial059.stdout: "num_evict_mode_full": 0, 2026-02-17T08:28:27.837 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_pinned": 0, 2026-02-17T08:28:27.837 INFO:tasks.workunit.client.0.trial059.stdout: "num_legacy_snapsets": 0, 2026-02-17T08:28:27.837 INFO:tasks.workunit.client.0.trial059.stdout: "num_large_omap_objects": 0, 2026-02-17T08:28:27.837 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_manifest": 0, 2026-02-17T08:28:27.837 INFO:tasks.workunit.client.0.trial059.stdout: "num_omap_bytes": 0, 2026-02-17T08:28:27.837 INFO:tasks.workunit.client.0.trial059.stdout: "num_omap_keys": 0, 2026-02-17T08:28:27.837 INFO:tasks.workunit.client.0.trial059.stdout: "num_objects_repaired": 0 2026-02-17T08:28:27.837 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.837 INFO:tasks.workunit.client.0.trial059.stdout: "up": [ 2026-02-17T08:28:27.837 INFO:tasks.workunit.client.0.trial059.stdout: 3, 2026-02-17T08:28:27.837 INFO:tasks.workunit.client.0.trial059.stdout: 1, 2026-02-17T08:28:27.837 INFO:tasks.workunit.client.0.trial059.stdout: 4, 2026-02-17T08:28:27.837 INFO:tasks.workunit.client.0.trial059.stdout: 0, 2026-02-17T08:28:27.837 INFO:tasks.workunit.client.0.trial059.stdout: 2 2026-02-17T08:28:27.837 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.837 INFO:tasks.workunit.client.0.trial059.stdout: "acting": [ 2026-02-17T08:28:27.837 INFO:tasks.workunit.client.0.trial059.stdout: 3, 2026-02-17T08:28:27.837 INFO:tasks.workunit.client.0.trial059.stdout: 1, 2026-02-17T08:28:27.837 INFO:tasks.workunit.client.0.trial059.stdout: 4, 2026-02-17T08:28:27.837 INFO:tasks.workunit.client.0.trial059.stdout: 0, 2026-02-17T08:28:27.837 INFO:tasks.workunit.client.0.trial059.stdout: 2 2026-02-17T08:28:27.838 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.838 INFO:tasks.workunit.client.0.trial059.stdout: "avail_no_missing": [ 2026-02-17T08:28:27.838 INFO:tasks.workunit.client.0.trial059.stdout: "3(0)", 2026-02-17T08:28:27.838 INFO:tasks.workunit.client.0.trial059.stdout: "0(3)", 2026-02-17T08:28:27.838 INFO:tasks.workunit.client.0.trial059.stdout: "1(1)", 2026-02-17T08:28:27.838 INFO:tasks.workunit.client.0.trial059.stdout: "4(2)" 2026-02-17T08:28:27.838 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.838 INFO:tasks.workunit.client.0.trial059.stdout: "object_location_counts": [ 2026-02-17T08:28:27.838 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:28:27.838 INFO:tasks.workunit.client.0.trial059.stdout: "shards": "0(3),1(1),3(0),4(2)", 2026-02-17T08:28:27.838 INFO:tasks.workunit.client.0.trial059.stdout: "objects": 101 2026-02-17T08:28:27.838 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:28:27.838 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.838 INFO:tasks.workunit.client.0.trial059.stdout: "blocked_by": [], 2026-02-17T08:28:27.838 INFO:tasks.workunit.client.0.trial059.stdout: "up_primary": 3, 2026-02-17T08:28:27.838 INFO:tasks.workunit.client.0.trial059.stdout: "acting_primary": 3, 2026-02-17T08:28:27.838 INFO:tasks.workunit.client.0.trial059.stdout: "purged_snaps": [] 2026-02-17T08:28:27.838 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.838 INFO:tasks.workunit.client.0.trial059.stdout: "empty": 0, 2026-02-17T08:28:27.838 INFO:tasks.workunit.client.0.trial059.stdout: "dne": 0, 2026-02-17T08:28:27.838 INFO:tasks.workunit.client.0.trial059.stdout: "incomplete": 0, 2026-02-17T08:28:27.838 INFO:tasks.workunit.client.0.trial059.stdout: "last_epoch_started": 53, 2026-02-17T08:28:27.838 INFO:tasks.workunit.client.0.trial059.stdout: "hit_set_history": { 2026-02-17T08:28:27.839 INFO:tasks.workunit.client.0.trial059.stdout: "current_last_update": "0'0", 2026-02-17T08:28:27.839 INFO:tasks.workunit.client.0.trial059.stdout: "history": [] 2026-02-17T08:28:27.839 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:28:27.839 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:28:27.839 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.839 INFO:tasks.workunit.client.0.trial059.stdout: "recovery_state": [ 2026-02-17T08:28:27.839 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:28:27.839 INFO:tasks.workunit.client.0.trial059.stdout: "name": "Started/Primary/Active", 2026-02-17T08:28:27.839 INFO:tasks.workunit.client.0.trial059.stdout: "enter_time": "2026-02-17T08:28:12.240336+0000", 2026-02-17T08:28:27.839 INFO:tasks.workunit.client.0.trial059.stdout: "might_have_unfound": [ 2026-02-17T08:28:27.839 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:28:27.839 INFO:tasks.workunit.client.0.trial059.stdout: "osd": "0(3)", 2026-02-17T08:28:27.839 INFO:tasks.workunit.client.0.trial059.stdout: "status": "already probed" 2026-02-17T08:28:27.839 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.839 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:28:27.839 INFO:tasks.workunit.client.0.trial059.stdout: "osd": "1(1)", 2026-02-17T08:28:27.839 INFO:tasks.workunit.client.0.trial059.stdout: "status": "already probed" 2026-02-17T08:28:27.839 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.839 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:28:27.839 INFO:tasks.workunit.client.0.trial059.stdout: "osd": "2(4)", 2026-02-17T08:28:27.840 INFO:tasks.workunit.client.0.trial059.stdout: "status": "already probed" 2026-02-17T08:28:27.840 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.840 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:28:27.840 INFO:tasks.workunit.client.0.trial059.stdout: "osd": "4(2)", 2026-02-17T08:28:27.840 INFO:tasks.workunit.client.0.trial059.stdout: "status": "already probed" 2026-02-17T08:28:27.840 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:28:27.840 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.840 INFO:tasks.workunit.client.0.trial059.stdout: "recovery_progress": { 2026-02-17T08:28:27.840 INFO:tasks.workunit.client.0.trial059.stdout: "backfill_targets": [], 2026-02-17T08:28:27.840 INFO:tasks.workunit.client.0.trial059.stdout: "waiting_on_backfill": [], 2026-02-17T08:28:27.840 INFO:tasks.workunit.client.0.trial059.stdout: "last_backfill_started": "MIN", 2026-02-17T08:28:27.840 INFO:tasks.workunit.client.0.trial059.stdout: "backfill_info": { 2026-02-17T08:28:27.840 INFO:tasks.workunit.client.0.trial059.stdout: "begin": "MIN", 2026-02-17T08:28:27.840 INFO:tasks.workunit.client.0.trial059.stdout: "end": "MIN", 2026-02-17T08:28:27.840 INFO:tasks.workunit.client.0.trial059.stdout: "objects": [] 2026-02-17T08:28:27.840 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.840 INFO:tasks.workunit.client.0.trial059.stdout: "peer_backfill_info": [], 2026-02-17T08:28:27.840 INFO:tasks.workunit.client.0.trial059.stdout: "backfills_in_flight": [], 2026-02-17T08:28:27.840 INFO:tasks.workunit.client.0.trial059.stdout: "recovering": [], 2026-02-17T08:28:27.840 INFO:tasks.workunit.client.0.trial059.stdout: "pg_backend": { 2026-02-17T08:28:27.840 INFO:tasks.workunit.client.0.trial059.stdout: "recovery_ops": [], 2026-02-17T08:28:27.840 INFO:tasks.workunit.client.0.trial059.stdout: "read_ops": [] 2026-02-17T08:28:27.841 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:28:27.841 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:28:27.841 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.841 INFO:tasks.workunit.client.0.trial059.stdout: { 2026-02-17T08:28:27.841 INFO:tasks.workunit.client.0.trial059.stdout: "name": "Started", 2026-02-17T08:28:27.841 INFO:tasks.workunit.client.0.trial059.stdout: "enter_time": "2026-02-17T08:28:12.139449+0000" 2026-02-17T08:28:27.841 INFO:tasks.workunit.client.0.trial059.stdout: } 2026-02-17T08:28:27.841 INFO:tasks.workunit.client.0.trial059.stdout: ], 2026-02-17T08:28:27.841 INFO:tasks.workunit.client.0.trial059.stdout: "scrubber": { 2026-02-17T08:28:27.841 INFO:tasks.workunit.client.0.trial059.stdout: "active": false, 2026-02-17T08:28:27.841 INFO:tasks.workunit.client.0.trial059.stdout: "must_scrub": false, 2026-02-17T08:28:27.841 INFO:tasks.workunit.client.0.trial059.stdout: "must_deep_scrub": false, 2026-02-17T08:28:27.841 INFO:tasks.workunit.client.0.trial059.stdout: "must_repair": false, 2026-02-17T08:28:27.841 INFO:tasks.workunit.client.0.trial059.stdout: "need_auto": false, 2026-02-17T08:28:27.841 INFO:tasks.workunit.client.0.trial059.stdout: "scrub_reg_stamp": "2026-02-18T12:10:50.694035+0000", 2026-02-17T08:28:27.841 INFO:tasks.workunit.client.0.trial059.stdout: "schedule": "no scrub is scheduled" 2026-02-17T08:28:27.841 INFO:tasks.workunit.client.0.trial059.stdout: }, 2026-02-17T08:28:27.841 INFO:tasks.workunit.client.0.trial059.stdout: "agent_state": {} 2026-02-17T08:28:27.841 INFO:tasks.workunit.client.0.trial059.stdout:} 2026-02-17T08:28:27.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:664: TEST_ec_recovery_unfound: ceph pg 2.0 list_unfound 2026-02-17T08:28:27.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:664: TEST_ec_recovery_unfound: grep -q obj75 2026-02-17T08:28:27.871 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:666: TEST_ec_recovery_unfound: ceph pg 2.0 list_unfound 2026-02-17T08:28:27.871 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:666: TEST_ec_recovery_unfound: jq .available_might_have_unfound 2026-02-17T08:28:27.947 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:666: TEST_ec_recovery_unfound: check=true 2026-02-17T08:28:27.947 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:667: TEST_ec_recovery_unfound: test true == true 2026-02-17T08:28:27.947 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:669: TEST_ec_recovery_unfound: ceph pg 2.0 list_unfound 2026-02-17T08:28:27.948 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:669: TEST_ec_recovery_unfound: jq '.might_have_unfound | length' 2026-02-17T08:28:28.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:669: TEST_ec_recovery_unfound: check=0 2026-02-17T08:28:28.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:670: TEST_ec_recovery_unfound: test 0 == 0 2026-02-17T08:28:28.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:673: TEST_ec_recovery_unfound: timeout 5 rados -p pool-jerasure get obj75 td/test-erasure-eio/CHECK 2026-02-17T08:28:33.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:674: TEST_ec_recovery_unfound: test 124 = 124 2026-02-17T08:28:33.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:676: TEST_ec_recovery_unfound: ceph pg 2.0 mark_unfound_lost delete 2026-02-17T08:28:33.097 INFO:tasks.workunit.client.0.trial059.stderr:pg has no unfound objects 2026-02-17T08:28:33.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:678: TEST_ec_recovery_unfound: wait_for_clean 2026-02-17T08:28:33.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:28:33.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:28:33.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:28:33.108 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:28:33.109 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:28:33.109 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:28:33.109 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:28:33.109 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:28:33.109 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:28:33.210 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:28:33.210 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:28:33.210 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:28:33.210 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:28:33.211 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:28:33.211 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:28:33.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:28:33.409 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:28:33.409 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:28:33.409 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:28:33.409 INFO:tasks.workunit.client.0.trial059.stderr:4' 2026-02-17T08:28:33.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:28:33.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:28:33.409 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:28:33.485 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803795 2026-02-17T08:28:33.485 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803795 2026-02-17T08:28:33.485 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803795' 2026-02-17T08:28:33.485 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:28:33.486 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:28:33.562 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=51539607570 2026-02-17T08:28:33.562 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 51539607570 2026-02-17T08:28:33.562 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803795 1-51539607570' 2026-02-17T08:28:33.562 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:28:33.562 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:28:33.637 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=210453397511 2026-02-17T08:28:33.637 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 210453397511 2026-02-17T08:28:33.637 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803795 1-51539607570 2-210453397511' 2026-02-17T08:28:33.637 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:28:33.637 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:28:33.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=111669149710 2026-02-17T08:28:33.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 111669149710 2026-02-17T08:28:33.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803795 1-51539607570 2-210453397511 3-111669149710' 2026-02-17T08:28:33.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:28:33.712 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:28:33.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=150323855372 2026-02-17T08:28:33.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 150323855372 2026-02-17T08:28:33.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803795 1-51539607570 2-210453397511 3-111669149710 4-150323855372' 2026-02-17T08:28:33.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:28:33.789 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803795 2026-02-17T08:28:33.789 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:28:33.790 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:28:33.791 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803795 2026-02-17T08:28:33.791 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:28:33.792 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803795 2026-02-17T08:28:33.792 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803795' 2026-02-17T08:28:33.793 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 25769803795 2026-02-17T08:28:33.793 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:28:33.998 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803793 -lt 25769803795 2026-02-17T08:28:33.998 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:28:34.999 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:28:35.000 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:28:35.194 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803796 -lt 25769803795 2026-02-17T08:28:35.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:28:35.195 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-51539607570 2026-02-17T08:28:35.195 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:28:35.196 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:28:35.197 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-51539607570 2026-02-17T08:28:35.197 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:28:35.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=51539607570 2026-02-17T08:28:35.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 51539607570' 2026-02-17T08:28:35.199 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 51539607570 2026-02-17T08:28:35.199 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:28:35.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 51539607570 -lt 51539607570 2026-02-17T08:28:35.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:28:35.409 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-210453397511 2026-02-17T08:28:35.409 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:28:35.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:28:35.411 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-210453397511 2026-02-17T08:28:35.411 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:28:35.412 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=210453397511 2026-02-17T08:28:35.412 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 210453397511' 2026-02-17T08:28:35.413 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 210453397511 2026-02-17T08:28:35.413 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:28:35.617 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 210453397511 -lt 210453397511 2026-02-17T08:28:35.617 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:28:35.617 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-111669149710 2026-02-17T08:28:35.618 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:28:35.618 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:28:35.619 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-111669149710 2026-02-17T08:28:35.619 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:28:35.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=111669149710 2026-02-17T08:28:35.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 111669149710' 2026-02-17T08:28:35.621 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 111669149710 2026-02-17T08:28:35.621 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:28:35.814 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 111669149710 -lt 111669149710 2026-02-17T08:28:35.814 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:28:35.815 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-150323855372 2026-02-17T08:28:35.815 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:28:35.816 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:28:35.817 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-150323855372 2026-02-17T08:28:35.817 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:28:35.818 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=150323855372 2026-02-17T08:28:35.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 150323855372' 2026-02-17T08:28:35.819 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.4 seq 150323855372 2026-02-17T08:28:35.819 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:28:36.020 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 150323855373 -lt 150323855372 2026-02-17T08:28:36.021 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:28:36.021 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:28:36.021 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:28:36.273 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:28:36.273 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:28:36.274 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:28:36.274 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:28:36.274 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:28:36.274 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:28:36.274 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:28:36.274 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:28:36.465 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:28:36.465 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:28:36.466 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:28:36.466 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:28:36.722 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:28:36.722 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:28:36.722 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:28:36.722 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: seq 1 100 2026-02-17T08:28:36.723 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:36.723 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj1 = obj75 ']' 2026-02-17T08:28:36.723 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj1 td/test-erasure-eio/CHECK 2026-02-17T08:28:36.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:36.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:36.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj2 = obj75 ']' 2026-02-17T08:28:36.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj2 td/test-erasure-eio/CHECK 2026-02-17T08:28:36.762 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:36.763 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:36.763 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj3 = obj75 ']' 2026-02-17T08:28:36.763 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj3 td/test-erasure-eio/CHECK 2026-02-17T08:28:36.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:36.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:36.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj4 = obj75 ']' 2026-02-17T08:28:36.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj4 td/test-erasure-eio/CHECK 2026-02-17T08:28:36.802 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:36.803 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:36.803 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj5 = obj75 ']' 2026-02-17T08:28:36.803 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj5 td/test-erasure-eio/CHECK 2026-02-17T08:28:36.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:36.827 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:36.827 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj6 = obj75 ']' 2026-02-17T08:28:36.827 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj6 td/test-erasure-eio/CHECK 2026-02-17T08:28:36.848 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:36.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:36.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj7 = obj75 ']' 2026-02-17T08:28:36.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj7 td/test-erasure-eio/CHECK 2026-02-17T08:28:36.870 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:36.871 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:36.871 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj8 = obj75 ']' 2026-02-17T08:28:36.871 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj8 td/test-erasure-eio/CHECK 2026-02-17T08:28:36.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:36.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:36.891 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj9 = obj75 ']' 2026-02-17T08:28:36.891 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj9 td/test-erasure-eio/CHECK 2026-02-17T08:28:36.911 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:36.912 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:36.912 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj10 = obj75 ']' 2026-02-17T08:28:36.912 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj10 td/test-erasure-eio/CHECK 2026-02-17T08:28:36.934 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:36.935 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:36.935 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj11 = obj75 ']' 2026-02-17T08:28:36.935 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj11 td/test-erasure-eio/CHECK 2026-02-17T08:28:36.957 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:36.958 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:36.958 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj12 = obj75 ']' 2026-02-17T08:28:36.959 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj12 td/test-erasure-eio/CHECK 2026-02-17T08:28:36.980 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:36.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:36.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj13 = obj75 ']' 2026-02-17T08:28:36.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj13 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.004 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.005 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj14 = obj75 ']' 2026-02-17T08:28:37.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj14 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.028 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.028 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj15 = obj75 ']' 2026-02-17T08:28:37.028 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj15 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj16 = obj75 ']' 2026-02-17T08:28:37.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj16 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj17 = obj75 ']' 2026-02-17T08:28:37.075 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj17 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.097 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.098 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.099 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj18 = obj75 ']' 2026-02-17T08:28:37.099 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj18 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.121 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj19 = obj75 ']' 2026-02-17T08:28:37.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj19 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.145 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj20 = obj75 ']' 2026-02-17T08:28:37.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj20 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.164 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.165 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.165 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj21 = obj75 ']' 2026-02-17T08:28:37.165 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj21 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj22 = obj75 ']' 2026-02-17T08:28:37.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj22 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.206 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.207 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.207 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj23 = obj75 ']' 2026-02-17T08:28:37.207 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj23 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.226 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj24 = obj75 ']' 2026-02-17T08:28:37.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj24 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.247 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.249 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.249 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj25 = obj75 ']' 2026-02-17T08:28:37.249 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj25 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.269 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.270 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.270 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj26 = obj75 ']' 2026-02-17T08:28:37.270 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj26 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.295 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.296 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.296 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj27 = obj75 ']' 2026-02-17T08:28:37.297 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj27 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.322 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.322 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj28 = obj75 ']' 2026-02-17T08:28:37.322 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj28 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.345 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.346 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj29 = obj75 ']' 2026-02-17T08:28:37.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj29 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.369 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.370 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.370 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj30 = obj75 ']' 2026-02-17T08:28:37.370 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj30 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.389 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.391 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.391 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj31 = obj75 ']' 2026-02-17T08:28:37.391 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj31 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj32 = obj75 ']' 2026-02-17T08:28:37.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj32 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.437 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.439 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.439 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj33 = obj75 ']' 2026-02-17T08:28:37.439 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj33 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.457 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.458 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.458 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj34 = obj75 ']' 2026-02-17T08:28:37.458 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj34 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.475 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.476 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.476 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj35 = obj75 ']' 2026-02-17T08:28:37.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj35 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.500 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.502 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.502 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj36 = obj75 ']' 2026-02-17T08:28:37.502 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj36 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.524 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.526 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.526 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj37 = obj75 ']' 2026-02-17T08:28:37.526 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj37 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.548 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.549 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.549 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj38 = obj75 ']' 2026-02-17T08:28:37.549 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj38 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.565 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.566 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.567 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj39 = obj75 ']' 2026-02-17T08:28:37.567 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj39 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj40 = obj75 ']' 2026-02-17T08:28:37.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj40 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj41 = obj75 ']' 2026-02-17T08:28:37.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj41 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.634 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.634 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj42 = obj75 ']' 2026-02-17T08:28:37.634 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj42 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj43 = obj75 ']' 2026-02-17T08:28:37.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj43 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj44 = obj75 ']' 2026-02-17T08:28:37.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj44 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj45 = obj75 ']' 2026-02-17T08:28:37.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj45 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.723 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.725 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.725 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj46 = obj75 ']' 2026-02-17T08:28:37.725 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj46 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj47 = obj75 ']' 2026-02-17T08:28:37.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj47 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.773 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj48 = obj75 ']' 2026-02-17T08:28:37.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj48 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.798 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.799 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.800 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj49 = obj75 ']' 2026-02-17T08:28:37.800 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj49 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.824 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj50 = obj75 ']' 2026-02-17T08:28:37.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj50 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj51 = obj75 ']' 2026-02-17T08:28:37.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj51 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.863 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.864 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.864 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj52 = obj75 ']' 2026-02-17T08:28:37.864 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj52 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj53 = obj75 ']' 2026-02-17T08:28:37.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj53 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj54 = obj75 ']' 2026-02-17T08:28:37.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj54 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.927 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj55 = obj75 ']' 2026-02-17T08:28:37.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj55 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj56 = obj75 ']' 2026-02-17T08:28:37.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj56 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj57 = obj75 ']' 2026-02-17T08:28:37.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj57 td/test-erasure-eio/CHECK 2026-02-17T08:28:37.990 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:37.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:37.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj58 = obj75 ']' 2026-02-17T08:28:37.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj58 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.009 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.009 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj59 = obj75 ']' 2026-02-17T08:28:38.009 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj59 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.028 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.028 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.029 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj60 = obj75 ']' 2026-02-17T08:28:38.029 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj60 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj61 = obj75 ']' 2026-02-17T08:28:38.052 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj61 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.075 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.075 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj62 = obj75 ']' 2026-02-17T08:28:38.075 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj62 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.097 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.097 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj63 = obj75 ']' 2026-02-17T08:28:38.097 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj63 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.118 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj64 = obj75 ']' 2026-02-17T08:28:38.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj64 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.138 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.138 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj65 = obj75 ']' 2026-02-17T08:28:38.138 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj65 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.158 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj66 = obj75 ']' 2026-02-17T08:28:38.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj66 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj67 = obj75 ']' 2026-02-17T08:28:38.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj67 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.201 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.202 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.202 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj68 = obj75 ']' 2026-02-17T08:28:38.203 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj68 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.219 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj69 = obj75 ']' 2026-02-17T08:28:38.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj69 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.247 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.247 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj70 = obj75 ']' 2026-02-17T08:28:38.247 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj70 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.269 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj71 = obj75 ']' 2026-02-17T08:28:38.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj71 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj72 = obj75 ']' 2026-02-17T08:28:38.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj72 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.306 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.307 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.307 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj73 = obj75 ']' 2026-02-17T08:28:38.307 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj73 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.326 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.327 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.327 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj74 = obj75 ']' 2026-02-17T08:28:38.327 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj74 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj75 = obj75 ']' 2026-02-17T08:28:38.348 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:684: TEST_ec_recovery_unfound: rados -p pool-jerasure get obj75 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.365 INFO:tasks.workunit.client.0.trial059.stderr:error getting pool-jerasure/obj75: (2) No such file or directory 2026-02-17T08:28:38.367 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.367 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj76 = obj75 ']' 2026-02-17T08:28:38.367 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj76 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.391 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.393 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.393 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj77 = obj75 ']' 2026-02-17T08:28:38.393 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj77 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.416 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.418 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj78 = obj75 ']' 2026-02-17T08:28:38.418 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj78 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.441 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.442 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.442 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj79 = obj75 ']' 2026-02-17T08:28:38.442 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj79 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.462 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.463 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.463 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj80 = obj75 ']' 2026-02-17T08:28:38.463 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj80 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.485 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj81 = obj75 ']' 2026-02-17T08:28:38.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj81 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.508 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.509 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.509 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj82 = obj75 ']' 2026-02-17T08:28:38.509 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj82 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.534 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.536 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.536 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj83 = obj75 ']' 2026-02-17T08:28:38.536 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj83 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.561 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.561 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj84 = obj75 ']' 2026-02-17T08:28:38.561 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj84 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj85 = obj75 ']' 2026-02-17T08:28:38.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj85 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj86 = obj75 ']' 2026-02-17T08:28:38.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj86 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj87 = obj75 ']' 2026-02-17T08:28:38.634 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj87 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj88 = obj75 ']' 2026-02-17T08:28:38.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj88 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.675 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.676 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.676 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj89 = obj75 ']' 2026-02-17T08:28:38.676 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj89 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.694 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj90 = obj75 ']' 2026-02-17T08:28:38.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj90 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.720 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.721 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj91 = obj75 ']' 2026-02-17T08:28:38.721 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj91 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.745 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj92 = obj75 ']' 2026-02-17T08:28:38.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj92 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.769 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.771 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.771 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj93 = obj75 ']' 2026-02-17T08:28:38.771 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj93 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.795 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.795 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj94 = obj75 ']' 2026-02-17T08:28:38.795 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj94 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.813 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.814 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.814 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj95 = obj75 ']' 2026-02-17T08:28:38.814 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj95 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.833 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj96 = obj75 ']' 2026-02-17T08:28:38.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj96 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.854 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj97 = obj75 ']' 2026-02-17T08:28:38.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj97 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.877 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.878 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.878 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj98 = obj75 ']' 2026-02-17T08:28:38.878 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj98 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.901 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.903 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj99 = obj75 ']' 2026-02-17T08:28:38.903 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj99 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.925 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:680: TEST_ec_recovery_unfound: for i in $(seq 1 $lastobj) 2026-02-17T08:28:38.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:682: TEST_ec_recovery_unfound: '[' obj100 = obj75 ']' 2026-02-17T08:28:38.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:686: TEST_ec_recovery_unfound: rados --pool pool-jerasure get obj100 td/test-erasure-eio/CHECK 2026-02-17T08:28:38.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:687: TEST_ec_recovery_unfound: diff -q td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:691: TEST_ec_recovery_unfound: rm -f td/test-erasure-eio/ORIGINAL td/test-erasure-eio/CHECK 2026-02-17T08:28:38.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:693: TEST_ec_recovery_unfound: delete_erasure_coded_pool pool-jerasure 2026-02-17T08:28:38.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:28:38.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-17T08:28:39.193 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' does not exist 2026-02-17T08:28:39.203 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-17T08:28:39.460 INFO:tasks.workunit.client.0.trial059.stderr:erasure-code-profile myprofile does not exist 2026-02-17T08:28:39.470 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-17T08:28:39.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:28:39.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:28:39.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:28:39.471 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:28:39.471 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:28:39.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:28:39.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:28:39.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:28:39.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:28:39.582 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:28:39.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:28:39.584 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:28:39.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:28:39.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:28:39.586 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:28:39.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:28:39.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:28:39.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:28:39.588 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:28:39.589 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:28:39.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:28:39.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:28:39.613 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:28:39.613 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:39.613 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:28:39.613 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:28:39.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:28:39.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:28:39.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-17T08:28:39.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-17T08:28:39.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-eio 2026-02-17T08:28:39.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-eio 2026-02-17T08:28:39.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:28:39.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:28:39.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:28:39.616 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:28:39.616 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:28:39.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:28:39.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:28:39.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:28:39.618 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:28:39.618 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:28:39.619 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:28:39.619 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:28:39.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:28:39.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:28:39.621 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:28:39.622 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:28:39.622 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:28:39.622 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:28:39.623 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:28:39.623 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:28:39.624 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:28:39.625 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:28:39.626 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:28:39.626 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:39.626 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:28:39.626 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:28:39.628 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:28:39.628 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:28:39.628 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-eio 2026-02-17T08:28:39.629 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:28:39.629 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:39.629 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:28:39.629 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.70936 2026-02-17T08:28:39.631 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:28:39.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:28:39.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:28:39.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-17T08:28:39.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-17T08:28:39.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-eio 2026-02-17T08:28:39.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:28:39.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:28:39.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:28:39.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-eio/a 2026-02-17T08:28:39.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-17T08:28:39.654 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:28:39.654 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:28:39.654 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:28:39.655 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:28:39.655 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:39.655 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:28:39.655 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:28:39.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T08:28:39.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:28:39.682 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:28:39.683 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:28:39.683 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:28:39.683 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:28:39.684 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:28:39.684 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:28:39.684 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:28:39.684 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:28:39.684 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:28:39.684 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:39.684 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:28:39.684 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:28:39.685 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:28:39.685 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get fsid 2026-02-17T08:28:39.739 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:28:39.739 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:28:39.739 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:28:39.740 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:28:39.740 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:28:39.741 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:28:39.741 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:28:39.741 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:28:39.741 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:28:39.741 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:39.741 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:28:39.741 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:28:39.741 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:28:39.742 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get mon_host 2026-02-17T08:28:39.795 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-17T08:28:39.795 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-eio 2026-02-17T08:28:39.795 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:28:39.795 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:28:39.795 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:28:39.795 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-eio/x 2026-02-17T08:28:39.795 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:28:39.902 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:28:39.902 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:28:39.902 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:28:39.902 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:28:39.902 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:39.902 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:28:39.903 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:28:39.903 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:28:39.903 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:28:39.923 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-17T08:28:39.923 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T08:28:40.041 INFO:tasks.workunit.client.0.trial059.stderr:pool 'rbd' already exists 2026-02-17T08:28:40.049 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:28:41.052 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-17T08:28:41.052 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:28:41.052 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:28:41.052 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:28:41.052 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:41.052 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:28:41.052 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:28:41.053 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-17T08:28:41.053 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-mon.a.asok log flush 2026-02-17T08:28:41.101 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:28:41.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-17T08:28:41.108 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:28:39.655+0000 7f24ce7ceec0 0 load: jerasure load: lrc 2026-02-17T08:28:41.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_ec_single_recovery_error td/test-erasure-eio 2026-02-17T08:28:41.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:390: TEST_ec_single_recovery_error: local dir=td/test-erasure-eio 2026-02-17T08:28:41.110 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:391: TEST_ec_single_recovery_error: local objname=myobject 2026-02-17T08:28:41.110 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:393: TEST_ec_single_recovery_error: setup_osds 7 2026-02-17T08:28:41.110 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=7 2026-02-17T08:28:41.110 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-17T08:28:41.110 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 7 - 1 2026-02-17T08:28:41.111 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 6 2026-02-17T08:28:41.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:28:41.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-17T08:28:41.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:28:41.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:28:41.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:28:41.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:28:41.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-17T08:28:41.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:28:41.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:28:41.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:28:41.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:28:41.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-17T08:28:41.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-17T08:28:41.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:28:41.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:28:41.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:28:41.115 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:28:41.115 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:28:41.116 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:28:41.116 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:28:41.116 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:41.116 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:28:41.116 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:28:41.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:28:41.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:28:41.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:28:41.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:28:41.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:28:41.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:28:41.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:28:41.117 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:28:41.117 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:28:41.117 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:28:41.117 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:28:41.117 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:28:41.117 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-17T08:28:41.118 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:28:41.118 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=58cdf610-6841-4a38-af29-bc7f4ebfb139 2026-02-17T08:28:41.118 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 58cdf610-6841-4a38-af29-bc7f4ebfb139' 2026-02-17T08:28:41.118 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 58cdf610-6841-4a38-af29-bc7f4ebfb139 2026-02-17T08:28:41.118 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:28:41.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQC5JpRpOJ3HBhAA9b6E/1chDlAdvA+Z07Gp9w== 2026-02-17T08:28:41.128 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQC5JpRpOJ3HBhAA9b6E/1chDlAdvA+Z07Gp9w=="}' 2026-02-17T08:28:41.128 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 58cdf610-6841-4a38-af29-bc7f4ebfb139 -i td/test-erasure-eio/0/new.json 2026-02-17T08:28:41.236 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:28:41.243 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-17T08:28:41.244 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC5JpRpOJ3HBhAA9b6E/1chDlAdvA+Z07Gp9w== --osd-uuid 58cdf610-6841-4a38-af29-bc7f4ebfb139 2026-02-17T08:28:41.260 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:41.243+0000 7f2614cdd8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:41.261 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:41.243+0000 7f2614cdd8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:41.262 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:41.243+0000 7f2614cdd8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:41.262 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:41.243+0000 7f2614cdd8c0 -1 bdev(0x5643c3b05c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:28:41.263 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:41.243+0000 7f2614cdd8c0 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-17T08:28:43.543 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-17T08:28:43.543 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:28:43.544 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:28:43.544 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:28:43.545 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:28:43.814 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:28:43.815 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:28:43.815 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:28:43.815 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:28:43.815 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:28:43.815 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:28:43.837 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:43.819+0000 7f8214efe8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:43.839 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:43.819+0000 7f8214efe8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:43.840 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:43.823+0000 7f8214efe8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:44.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:28:44.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:28:44.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:28:44.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:28:44.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:28:44.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:44.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:28:44.009 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:28:44.009 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:44.009 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:28:44.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:45.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:45.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:45.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:28:45.225 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:28:45.226 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:45.226 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:28:45.361 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:45.343+0000 7f8214efe8c0 -1 Falling back to public interface 2026-02-17T08:28:45.423 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:46.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:46.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:46.425 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:28:46.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:28:46.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:46.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:28:46.624 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:47.625 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:47.626 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:47.626 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:28:47.626 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:28:47.627 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:47.627 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:28:47.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:48.415 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:48.395+0000 7f8214efe8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:28:48.827 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:48.827 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:48.828 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:28:48.828 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:28:48.829 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:48.829 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:28:49.029 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:50.030 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:50.030 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:50.030 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:28:50.030 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:28:50.030 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:50.031 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:28:50.229 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3983859856,v1:127.0.0.1:6803/3983859856] [v2:127.0.0.1:6804/3983859856,v1:127.0.0.1:6805/3983859856] exists,up 58cdf610-6841-4a38-af29-bc7f4ebfb139 2026-02-17T08:28:50.232 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:28:50.233 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:28:50.233 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:28:50.233 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:28:50.233 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-17T08:28:50.233 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:28:50.233 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:28:50.233 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T08:28:50.233 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:28:50.233 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-17T08:28:50.234 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:28:50.234 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:28:50.234 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:28:50.234 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:28:50.234 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-17T08:28:50.234 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-17T08:28:50.234 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:28:50.234 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:28:50.234 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:28:50.234 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:28:50.234 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:28:50.234 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:28:50.235 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:28:50.235 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:50.235 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:28:50.235 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:28:50.235 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:28:50.235 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:28:50.235 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:28:50.235 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:28:50.235 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:28:50.235 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:28:50.235 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:28:50.235 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:28:50.236 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:28:50.236 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:28:50.236 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:28:50.236 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:28:50.236 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-17T08:28:50.237 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:28:50.237 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=6b7d227b-e7ff-49ce-94df-3f54e8b4fb73 2026-02-17T08:28:50.237 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 6b7d227b-e7ff-49ce-94df-3f54e8b4fb73' 2026-02-17T08:28:50.237 INFO:tasks.workunit.client.0.trial059.stdout:add osd1 6b7d227b-e7ff-49ce-94df-3f54e8b4fb73 2026-02-17T08:28:50.237 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:28:50.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDCJpRpIprYDRAA0Cmdi3jWVKajHy245t6tDg== 2026-02-17T08:28:50.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDCJpRpIprYDRAA0Cmdi3jWVKajHy245t6tDg=="}' 2026-02-17T08:28:50.247 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 6b7d227b-e7ff-49ce-94df-3f54e8b4fb73 -i td/test-erasure-eio/1/new.json 2026-02-17T08:28:50.454 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:28:50.463 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-17T08:28:50.464 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDCJpRpIprYDRAA0Cmdi3jWVKajHy245t6tDg== --osd-uuid 6b7d227b-e7ff-49ce-94df-3f54e8b4fb73 2026-02-17T08:28:50.480 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:50.463+0000 7f8949b3f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:50.481 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:50.463+0000 7f8949b3f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:50.482 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:50.463+0000 7f8949b3f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:50.483 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:50.463+0000 7f8949b3f8c0 -1 bdev(0x55983dd8dc00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-17T08:28:50.483 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:50.463+0000 7f8949b3f8c0 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-17T08:28:52.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-17T08:28:52.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:28:52.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T08:28:52.751 INFO:tasks.workunit.client.0.trial059.stdout:adding osd1 key to auth repository 2026-02-17T08:28:52.751 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:28:53.020 INFO:tasks.workunit.client.0.trial059.stdout:start osd.1 2026-02-17T08:28:53.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T08:28:53.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:28:53.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:28:53.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:28:53.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:28:53.042 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:53.022+0000 7f66c8dce8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:53.043 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:53.026+0000 7f66c8dce8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:53.044 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:53.026+0000 7f66c8dce8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:53.216 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T08:28:53.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:28:53.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:28:53.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:28:53.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:28:53.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:53.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:28:53.218 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:28:53.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:53.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:28:53.419 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:54.420 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:54.420 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:54.421 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:28:54.421 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:28:54.421 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:54.421 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:28:54.545 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:54.526+0000 7f66c8dce8c0 -1 Falling back to public interface 2026-02-17T08:28:54.618 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:55.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:55.620 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:55.620 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:28:55.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:28:55.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:55.621 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:28:55.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:56.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:56.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:56.823 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:28:56.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:28:56.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:56.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:28:57.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:57.763 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:57.746+0000 7f66c8dce8c0 -1 osd.1 0 log_to_monitors true 2026-02-17T08:28:58.024 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:58.025 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:58.025 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:28:58.025 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:28:58.026 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:58.026 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:28:58.222 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:28:59.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:28:59.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:28:59.224 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:28:59.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:28:59.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:28:59.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:28:59.422 INFO:tasks.workunit.client.0.trial059.stdout:osd.1 up in weight 1 up_from 12 up_thru 12 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1467051710,v1:127.0.0.1:6811/1467051710] [v2:127.0.0.1:6812/1467051710,v1:127.0.0.1:6813/1467051710] exists,up 6b7d227b-e7ff-49ce-94df-3f54e8b4fb73 2026-02-17T08:28:59.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:28:59.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:28:59.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:28:59.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:28:59.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-17T08:28:59.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:28:59.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:28:59.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T08:28:59.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:28:59.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-17T08:28:59.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:28:59.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:28:59.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:28:59.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:28:59.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-17T08:28:59.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-17T08:28:59.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:28:59.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:28:59.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:28:59.427 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:28:59.427 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:28:59.427 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:28:59.427 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:28:59.427 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:28:59.427 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:28:59.427 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:28:59.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:28:59.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:28:59.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:28:59.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:28:59.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:28:59.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:28:59.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:28:59.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:28:59.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:28:59.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:28:59.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:28:59.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:28:59.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-17T08:28:59.429 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:28:59.429 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=08a8a06c-507c-4d34-b181-c934bdd6d9f7 2026-02-17T08:28:59.429 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 08a8a06c-507c-4d34-b181-c934bdd6d9f7' 2026-02-17T08:28:59.430 INFO:tasks.workunit.client.0.trial059.stdout:add osd2 08a8a06c-507c-4d34-b181-c934bdd6d9f7 2026-02-17T08:28:59.430 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:28:59.438 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDLJpRp55tBGRAAGUhRERbkVhgm2xh3Cy2gxQ== 2026-02-17T08:28:59.438 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDLJpRp55tBGRAAGUhRERbkVhgm2xh3Cy2gxQ=="}' 2026-02-17T08:28:59.438 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 08a8a06c-507c-4d34-b181-c934bdd6d9f7 -i td/test-erasure-eio/2/new.json 2026-02-17T08:28:59.643 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:28:59.654 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-17T08:28:59.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDLJpRp55tBGRAAGUhRERbkVhgm2xh3Cy2gxQ== --osd-uuid 08a8a06c-507c-4d34-b181-c934bdd6d9f7 2026-02-17T08:28:59.677 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:59.658+0000 7f821b8168c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:59.678 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:59.658+0000 7f821b8168c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:59.680 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:59.662+0000 7f821b8168c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:28:59.680 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:59.662+0000 7f821b8168c0 -1 bdev(0x561d597d7c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-17T08:28:59.680 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:28:59.662+0000 7f821b8168c0 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-17T08:29:01.969 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-17T08:29:01.969 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:29:01.970 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T08:29:01.970 INFO:tasks.workunit.client.0.trial059.stdout:adding osd2 key to auth repository 2026-02-17T08:29:01.971 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:29:02.246 INFO:tasks.workunit.client.0.trial059.stdout:start osd.2 2026-02-17T08:29:02.247 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T08:29:02.247 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:29:02.247 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:29:02.247 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:29:02.247 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:29:02.270 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:02.250+0000 7f7a6faf68c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:02.271 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:02.254+0000 7f7a6faf68c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:02.273 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:02.254+0000 7f7a6faf68c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:02.442 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T08:29:02.442 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:29:02.442 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:29:02.443 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:29:02.443 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:29:02.443 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:02.443 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:29:02.444 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:29:02.444 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:02.444 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:29:02.641 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:03.643 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:03.643 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:03.643 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:29:03.644 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:29:03.644 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:03.644 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:29:03.841 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:04.001 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:03.982+0000 7f7a6faf68c0 -1 Falling back to public interface 2026-02-17T08:29:04.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:04.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:04.843 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:29:04.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:29:04.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:04.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:29:05.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:06.044 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:06.044 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:06.044 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:29:06.045 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:29:06.045 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:06.045 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:29:06.242 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:06.959 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:06.938+0000 7f7a6faf68c0 -1 osd.2 0 log_to_monitors true 2026-02-17T08:29:07.244 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:07.244 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:07.245 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:29:07.245 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:29:07.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:07.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:29:07.440 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:08.441 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:08.441 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:08.442 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:29:08.442 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:29:08.442 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:08.443 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:29:08.643 INFO:tasks.workunit.client.0.trial059.stdout:osd.2 up in weight 1 up_from 17 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2232783991,v1:127.0.0.1:6819/2232783991] [v2:127.0.0.1:6820/2232783991,v1:127.0.0.1:6821/2232783991] exists,up 08a8a06c-507c-4d34-b181-c934bdd6d9f7 2026-02-17T08:29:08.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:29:08.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:29:08.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:29:08.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:29:08.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-17T08:29:08.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:29:08.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:29:08.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2026-02-17T08:29:08.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:29:08.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-17T08:29:08.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:29:08.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:29:08.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:29:08.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:29:08.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-17T08:29:08.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-17T08:29:08.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:29:08.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:29:08.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:29:08.647 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:29:08.647 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:29:08.648 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:29:08.648 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:29:08.648 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:29:08.648 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:29:08.648 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:29:08.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:29:08.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:29:08.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:29:08.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:29:08.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:29:08.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:29:08.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:29:08.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:29:08.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:29:08.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:29:08.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:29:08.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:29:08.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-17T08:29:08.650 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:29:08.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=8f01dfb5-8caa-472d-8677-5dd4149e1a97 2026-02-17T08:29:08.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 8f01dfb5-8caa-472d-8677-5dd4149e1a97' 2026-02-17T08:29:08.650 INFO:tasks.workunit.client.0.trial059.stdout:add osd3 8f01dfb5-8caa-472d-8677-5dd4149e1a97 2026-02-17T08:29:08.650 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:29:08.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDUJpRpVY9oJhAALdD4U/3geiLRQvdmY10vOA== 2026-02-17T08:29:08.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDUJpRpVY9oJhAALdD4U/3geiLRQvdmY10vOA=="}' 2026-02-17T08:29:08.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 8f01dfb5-8caa-472d-8677-5dd4149e1a97 -i td/test-erasure-eio/3/new.json 2026-02-17T08:29:08.867 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:29:08.876 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-17T08:29:08.877 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDUJpRpVY9oJhAALdD4U/3geiLRQvdmY10vOA== --osd-uuid 8f01dfb5-8caa-472d-8677-5dd4149e1a97 2026-02-17T08:29:08.893 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:08.874+0000 7efd64c998c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:08.894 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:08.874+0000 7efd64c998c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:08.895 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:08.874+0000 7efd64c998c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:08.896 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:08.878+0000 7efd64c998c0 -1 bdev(0x560e014c5c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-17T08:29:08.896 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:08.878+0000 7efd64c998c0 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-17T08:29:11.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-17T08:29:11.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:29:11.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2026-02-17T08:29:11.179 INFO:tasks.workunit.client.0.trial059.stdout:adding osd3 key to auth repository 2026-02-17T08:29:11.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:29:11.448 INFO:tasks.workunit.client.0.trial059.stdout:start osd.3 2026-02-17T08:29:11.449 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2026-02-17T08:29:11.449 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:29:11.449 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:29:11.449 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:29:11.450 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:29:11.464 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:11.446+0000 7f5f15c278c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:11.466 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:11.446+0000 7f5f15c278c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:11.467 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:11.446+0000 7f5f15c278c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:11.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2026-02-17T08:29:11.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:29:11.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T08:29:11.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:29:11.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:29:11.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:11.650 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:29:11.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:29:11.651 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:11.651 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:29:11.846 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:12.847 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:12.847 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:12.848 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:29:12.848 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:29:12.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:12.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:29:12.969 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:12.950+0000 7f5f15c278c0 -1 Falling back to public interface 2026-02-17T08:29:13.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:14.052 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:14.052 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:14.053 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:29:14.053 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:29:14.054 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:14.054 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:29:14.248 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:15.250 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:15.250 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:15.250 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:29:15.251 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:29:15.251 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:15.251 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:29:15.449 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:15.942 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:15.922+0000 7f5f15c278c0 -1 osd.3 0 log_to_monitors true 2026-02-17T08:29:16.450 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:16.450 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:16.451 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:29:16.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:29:16.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:16.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:29:16.646 INFO:tasks.workunit.client.0.trial059.stdout:osd.3 up in weight 1 up_from 24 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/58978713,v1:127.0.0.1:6827/58978713] [v2:127.0.0.1:6828/58978713,v1:127.0.0.1:6829/58978713] exists,up 8f01dfb5-8caa-472d-8677-5dd4149e1a97 2026-02-17T08:29:16.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:29:16.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:29:16.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:29:16.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:29:16.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 4 2026-02-17T08:29:16.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:29:16.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:29:16.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=4 2026-02-17T08:29:16.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:29:16.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/4 2026-02-17T08:29:16.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:29:16.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:29:16.651 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:29:16.651 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:29:16.651 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/4' 2026-02-17T08:29:16.651 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/4/journal' 2026-02-17T08:29:16.651 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:29:16.651 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:29:16.651 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:29:16.651 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:29:16.651 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:29:16.651 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:29:16.651 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:29:16.651 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:29:16.652 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:29:16.652 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:29:16.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:29:16.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:29:16.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:29:16.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:29:16.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:29:16.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:29:16.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:29:16.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:29:16.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:29:16.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:29:16.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:29:16.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:29:16.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/4 2026-02-17T08:29:16.653 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:29:16.654 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=0fea9762-d1a0-4c3f-a61e-e24d1e5da3eb 2026-02-17T08:29:16.654 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd4 0fea9762-d1a0-4c3f-a61e-e24d1e5da3eb' 2026-02-17T08:29:16.654 INFO:tasks.workunit.client.0.trial059.stdout:add osd4 0fea9762-d1a0-4c3f-a61e-e24d1e5da3eb 2026-02-17T08:29:16.654 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:29:16.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDcJpRpo5ajJhAApOcNDsGy0P5/g+an0ZwGFQ== 2026-02-17T08:29:16.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDcJpRpo5ajJhAApOcNDsGy0P5/g+an0ZwGFQ=="}' 2026-02-17T08:29:16.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 0fea9762-d1a0-4c3f-a61e-e24d1e5da3eb -i td/test-erasure-eio/4/new.json 2026-02-17T08:29:16.872 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:29:16.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/4/new.json 2026-02-17T08:29:16.882 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 4 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDcJpRpo5ajJhAApOcNDsGy0P5/g+an0ZwGFQ== --osd-uuid 0fea9762-d1a0-4c3f-a61e-e24d1e5da3eb 2026-02-17T08:29:16.898 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:16.878+0000 7f9b503c18c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:16.899 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:16.878+0000 7f9b503c18c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:16.900 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:16.882+0000 7f9b503c18c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:16.901 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:16.882+0000 7f9b503c18c0 -1 bdev(0x558fef209c00 td/test-erasure-eio/4/block) open stat got: (1) Operation not permitted 2026-02-17T08:29:16.901 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:16.882+0000 7f9b503c18c0 -1 bluestore(td/test-erasure-eio/4) _read_fsid unparsable uuid 2026-02-17T08:29:19.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/4/keyring 2026-02-17T08:29:19.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:29:19.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd4 key to auth repository 2026-02-17T08:29:19.225 INFO:tasks.workunit.client.0.trial059.stdout:adding osd4 key to auth repository 2026-02-17T08:29:19.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:29:19.497 INFO:tasks.workunit.client.0.trial059.stdout:start osd.4 2026-02-17T08:29:19.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.4 2026-02-17T08:29:19.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 4 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/4 --osd-journal=td/test-erasure-eio/4/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:29:19.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:29:19.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:29:19.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:29:19.520 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:19.502+0000 7f9aa40618c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:19.522 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:19.502+0000 7f9aa40618c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:19.523 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:19.502+0000 7f9aa40618c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:19.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 4 2026-02-17T08:29:19.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:29:19.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=4 2026-02-17T08:29:19.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:29:19.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:29:19.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:19.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:29:19.697 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:29:19.697 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:19.697 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:29:19.896 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:20.897 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:20.898 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:20.898 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:29:20.898 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:29:20.899 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:20.899 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:29:21.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:21.225 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:21.206+0000 7f9aa40618c0 -1 Falling back to public interface 2026-02-17T08:29:22.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:22.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:22.097 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:29:22.097 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:29:22.097 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:22.098 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:29:22.292 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:23.294 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:23.295 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:23.295 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:29:23.296 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:29:23.297 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:23.297 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:29:23.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:24.235 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:24.214+0000 7f9aa40618c0 -1 osd.4 0 log_to_monitors true 2026-02-17T08:29:24.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:24.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:24.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:29:24.495 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:29:24.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:24.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:29:24.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:25.698 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:25.698 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:25.698 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:29:25.699 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:29:25.699 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:25.699 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.4 up' 2026-02-17T08:29:25.901 INFO:tasks.workunit.client.0.trial059.stdout:osd.4 up in weight 1 up_from 32 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/4280453712,v1:127.0.0.1:6835/4280453712] [v2:127.0.0.1:6836/4280453712,v1:127.0.0.1:6837/4280453712] exists,up 0fea9762-d1a0-4c3f-a61e-e24d1e5da3eb 2026-02-17T08:29:25.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:29:25.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:29:25.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:29:25.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:29:25.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 5 2026-02-17T08:29:25.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:29:25.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:29:25.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=5 2026-02-17T08:29:25.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:29:25.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/5 2026-02-17T08:29:25.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:29:25.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:29:25.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:29:25.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:29:25.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/5' 2026-02-17T08:29:25.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/5/journal' 2026-02-17T08:29:25.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:29:25.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:29:25.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:29:25.907 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:29:25.907 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:29:25.907 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:29:25.907 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:29:25.907 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:29:25.907 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:29:25.907 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:29:25.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:29:25.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:29:25.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:29:25.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:29:25.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:29:25.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:29:25.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:29:25.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:29:25.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:29:25.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:29:25.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:29:25.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:29:25.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/5 2026-02-17T08:29:25.909 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:29:25.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=75df4a3a-ef13-4789-9c93-ddc4c8907760 2026-02-17T08:29:25.910 INFO:tasks.workunit.client.0.trial059.stdout:add osd5 75df4a3a-ef13-4789-9c93-ddc4c8907760 2026-02-17T08:29:25.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd5 75df4a3a-ef13-4789-9c93-ddc4c8907760' 2026-02-17T08:29:25.910 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:29:25.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDlJpRpv6zhNRAAjsDbG2sQskvN7OD1FPp0Hw== 2026-02-17T08:29:25.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDlJpRpv6zhNRAAjsDbG2sQskvN7OD1FPp0Hw=="}' 2026-02-17T08:29:25.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 75df4a3a-ef13-4789-9c93-ddc4c8907760 -i td/test-erasure-eio/5/new.json 2026-02-17T08:29:26.126 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:29:26.135 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/5/new.json 2026-02-17T08:29:26.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 5 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDlJpRpv6zhNRAAjsDbG2sQskvN7OD1FPp0Hw== --osd-uuid 75df4a3a-ef13-4789-9c93-ddc4c8907760 2026-02-17T08:29:26.152 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:26.134+0000 7f78097a08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:26.154 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:26.134+0000 7f78097a08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:26.155 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:26.134+0000 7f78097a08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:26.155 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:26.134+0000 7f78097a08c0 -1 bdev(0x55b312975c00 td/test-erasure-eio/5/block) open stat got: (1) Operation not permitted 2026-02-17T08:29:26.156 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:26.138+0000 7f78097a08c0 -1 bluestore(td/test-erasure-eio/5) _read_fsid unparsable uuid 2026-02-17T08:29:28.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/5/keyring 2026-02-17T08:29:28.429 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:29:28.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd5 key to auth repository 2026-02-17T08:29:28.430 INFO:tasks.workunit.client.0.trial059.stdout:adding osd5 key to auth repository 2026-02-17T08:29:28.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:29:28.703 INFO:tasks.workunit.client.0.trial059.stdout:start osd.5 2026-02-17T08:29:28.704 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.5 2026-02-17T08:29:28.704 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 5 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/5 --osd-journal=td/test-erasure-eio/5/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:29:28.704 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:29:28.704 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:29:28.704 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:29:28.726 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:28.706+0000 7fbe6cfff8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:28.728 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:28.710+0000 7fbe6cfff8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:28.729 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:28.710+0000 7fbe6cfff8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:28.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 5 2026-02-17T08:29:28.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:29:28.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=5 2026-02-17T08:29:28.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:29:28.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:29:28.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:28.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:29:28.905 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:29:28.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:28.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:29:29.104 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:30.106 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:30.106 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:30.106 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:29:30.107 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:29:30.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:30.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:29:30.233 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:30.214+0000 7fbe6cfff8c0 -1 Falling back to public interface 2026-02-17T08:29:30.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:31.305 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:31.306 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:31.306 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:29:31.307 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:29:31.307 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:31.307 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:29:31.502 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:32.504 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:32.504 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:32.504 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:29:32.505 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:29:32.505 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:32.505 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:29:32.704 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:33.487 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:33.466+0000 7fbe6cfff8c0 -1 osd.5 0 log_to_monitors true 2026-02-17T08:29:33.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:33.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:33.706 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:29:33.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:29:33.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:33.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:29:33.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:34.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:34.911 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:34.911 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:29:34.912 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:29:34.912 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:34.912 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.5 up' 2026-02-17T08:29:35.107 INFO:tasks.workunit.client.0.trial059.stdout:osd.5 up in weight 1 up_from 41 up_thru 42 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/2185228633,v1:127.0.0.1:6843/2185228633] [v2:127.0.0.1:6844/2185228633,v1:127.0.0.1:6845/2185228633] exists,up 75df4a3a-ef13-4789-9c93-ddc4c8907760 2026-02-17T08:29:35.111 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:29:35.111 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:29:35.111 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:29:35.111 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:29:35.111 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 6 2026-02-17T08:29:35.111 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:29:35.111 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:29:35.111 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=6 2026-02-17T08:29:35.111 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:29:35.111 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/6 2026-02-17T08:29:35.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:29:35.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:29:35.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:29:35.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:29:35.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/6' 2026-02-17T08:29:35.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/6/journal' 2026-02-17T08:29:35.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:29:35.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:29:35.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:29:35.112 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:29:35.112 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:29:35.113 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:29:35.113 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:29:35.113 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:29:35.113 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:29:35.113 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:29:35.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:29:35.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:29:35.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:29:35.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:29:35.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:29:35.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:29:35.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:29:35.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:29:35.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:29:35.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:29:35.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:29:35.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:29:35.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/6 2026-02-17T08:29:35.115 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:29:35.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=7c4e4829-75a0-46ff-b353-b46fd16eb39a 2026-02-17T08:29:35.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd6 7c4e4829-75a0-46ff-b353-b46fd16eb39a' 2026-02-17T08:29:35.115 INFO:tasks.workunit.client.0.trial059.stdout:add osd6 7c4e4829-75a0-46ff-b353-b46fd16eb39a 2026-02-17T08:29:35.115 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:29:35.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDvJpRpD3SSBhAAEHpQksgcwAOGxxVTbP0bRw== 2026-02-17T08:29:35.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDvJpRpD3SSBhAAEHpQksgcwAOGxxVTbP0bRw=="}' 2026-02-17T08:29:35.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 7c4e4829-75a0-46ff-b353-b46fd16eb39a -i td/test-erasure-eio/6/new.json 2026-02-17T08:29:35.333 INFO:tasks.workunit.client.0.trial059.stdout:6 2026-02-17T08:29:35.342 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/6/new.json 2026-02-17T08:29:35.343 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 6 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDvJpRpD3SSBhAAEHpQksgcwAOGxxVTbP0bRw== --osd-uuid 7c4e4829-75a0-46ff-b353-b46fd16eb39a 2026-02-17T08:29:35.360 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:35.338+0000 7f0aca5c98c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:35.361 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:35.342+0000 7f0aca5c98c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:35.362 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:35.342+0000 7f0aca5c98c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:35.363 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:35.342+0000 7f0aca5c98c0 -1 bdev(0x563f13741c00 td/test-erasure-eio/6/block) open stat got: (1) Operation not permitted 2026-02-17T08:29:35.363 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:35.342+0000 7f0aca5c98c0 -1 bluestore(td/test-erasure-eio/6) _read_fsid unparsable uuid 2026-02-17T08:29:37.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/6/keyring 2026-02-17T08:29:37.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:29:37.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd6 key to auth repository 2026-02-17T08:29:37.650 INFO:tasks.workunit.client.0.trial059.stdout:adding osd6 key to auth repository 2026-02-17T08:29:37.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:29:37.930 INFO:tasks.workunit.client.0.trial059.stdout:start osd.6 2026-02-17T08:29:37.931 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.6 2026-02-17T08:29:37.931 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 6 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/6 --osd-journal=td/test-erasure-eio/6/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:29:37.931 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:29:37.931 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:29:37.931 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:29:37.945 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:37.926+0000 7fa3a66608c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:37.947 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:37.926+0000 7fa3a66608c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:37.948 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:37.930+0000 7fa3a66608c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:29:38.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 6 2026-02-17T08:29:38.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:29:38.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=6 2026-02-17T08:29:38.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:29:38.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:29:38.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:38.127 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:29:38.128 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:29:38.128 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:38.128 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:29:38.328 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:39.330 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:39.330 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:39.330 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:29:39.331 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:29:39.331 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:39.331 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:29:39.441 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:39.422+0000 7fa3a66608c0 -1 Falling back to public interface 2026-02-17T08:29:39.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:40.533 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:40.533 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:40.534 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:29:40.534 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:29:40.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:40.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:29:40.728 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:41.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:41.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:41.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:29:41.731 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:29:41.731 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:41.731 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:29:41.924 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:42.742 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:29:42.726+0000 7fa3a66608c0 -1 osd.6 0 log_to_monitors true 2026-02-17T08:29:42.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:42.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:42.926 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:29:42.927 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:29:42.927 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:42.927 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:29:43.158 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:29:44.160 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:29:44.160 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:29:44.160 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:29:44.161 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:29:44.161 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:29:44.161 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.6 up' 2026-02-17T08:29:44.360 INFO:tasks.workunit.client.0.trial059.stdout:osd.6 up in weight 1 up_from 49 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/1325776481,v1:127.0.0.1:6851/1325776481] [v2:127.0.0.1:6852/1325776481,v1:127.0.0.1:6853/1325776481] exists,up 7c4e4829-75a0-46ff-b353-b46fd16eb39a 2026-02-17T08:29:44.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:29:44.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:29:44.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:29:44.362 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-17T08:29:44.362 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:29:44.362 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:29:44.362 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:29:44.362 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:29:44.362 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:29:44.363 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.0.asok 2026-02-17T08:29:44.363 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-17T08:29:44.363 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.0.asok log flush 2026-02-17T08:29:44.424 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:29:44.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-17T08:29:44.432 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:28:45.347+0000 7f8214efe8c0 0 load: jerasure load: lrc 2026-02-17T08:29:44.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:395: TEST_ec_single_recovery_error: local poolname=pool-jerasure 2026-02-17T08:29:44.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:396: TEST_ec_single_recovery_error: create_erasure_coded_pool pool-jerasure 3 2 2026-02-17T08:29:44.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:29:44.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-17T08:29:44.433 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=3 2026-02-17T08:29:44.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-17T08:29:44.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=2 2026-02-17T08:29:44.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-17T08:29:44.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=3 m=2 crush-failure-domain=osd 2026-02-17T08:29:44.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-17T08:29:44.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-17T08:29:45.045 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' already exists 2026-02-17T08:29:45.055 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:29:46.056 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-17T08:29:46.057 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:29:46.057 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:29:46.057 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:29:46.057 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:29:46.058 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:29:46.058 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:29:46.058 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:29:46.058 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:29:46.058 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:29:46.155 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:29:46.155 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:29:46.155 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:29:46.156 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:29:46.156 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:29:46.156 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:29:46.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:29:46.355 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:29:46.355 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:29:46.355 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:29:46.355 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:29:46.355 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:29:46.355 INFO:tasks.workunit.client.0.trial059.stderr:6' 2026-02-17T08:29:46.356 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:29:46.356 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:29:46.356 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:29:46.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803790 2026-02-17T08:29:46.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803790 2026-02-17T08:29:46.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803790' 2026-02-17T08:29:46.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:29:46.431 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:29:46.505 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=51539607564 2026-02-17T08:29:46.505 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 51539607564 2026-02-17T08:29:46.505 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803790 1-51539607564' 2026-02-17T08:29:46.505 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:29:46.506 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:29:46.581 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=73014444042 2026-02-17T08:29:46.581 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 73014444042 2026-02-17T08:29:46.581 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803790 1-51539607564 2-73014444042' 2026-02-17T08:29:46.581 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:29:46.582 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:29:46.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=103079215112 2026-02-17T08:29:46.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 103079215112 2026-02-17T08:29:46.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803790 1-51539607564 2-73014444042 3-103079215112' 2026-02-17T08:29:46.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:29:46.655 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:29:46.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=137438953479 2026-02-17T08:29:46.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 137438953479 2026-02-17T08:29:46.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803790 1-51539607564 2-73014444042 3-103079215112 4-137438953479' 2026-02-17T08:29:46.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:29:46.730 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-17T08:29:46.804 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=176093659141 2026-02-17T08:29:46.805 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 176093659141 2026-02-17T08:29:46.805 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803790 1-51539607564 2-73014444042 3-103079215112 4-137438953479 5-176093659141' 2026-02-17T08:29:46.805 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:29:46.805 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-17T08:29:46.880 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=210453397507 2026-02-17T08:29:46.880 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 210453397507 2026-02-17T08:29:46.880 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803790 1-51539607564 2-73014444042 3-103079215112 4-137438953479 5-176093659141 6-210453397507' 2026-02-17T08:29:46.880 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:29:46.881 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803790 2026-02-17T08:29:46.881 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:29:46.882 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:29:46.883 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803790 2026-02-17T08:29:46.883 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:29:46.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803790 2026-02-17T08:29:46.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803790' 2026-02-17T08:29:46.885 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 25769803790 2026-02-17T08:29:46.885 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:29:47.085 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803788 -lt 25769803790 2026-02-17T08:29:47.085 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:29:48.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:29:48.087 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:29:48.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803790 -lt 25769803790 2026-02-17T08:29:48.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:29:48.282 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-51539607564 2026-02-17T08:29:48.282 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:29:48.283 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:29:48.284 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-51539607564 2026-02-17T08:29:48.284 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:29:48.286 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=51539607564 2026-02-17T08:29:48.286 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 51539607564 2026-02-17T08:29:48.286 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 51539607564' 2026-02-17T08:29:48.287 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:29:48.494 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 51539607564 -lt 51539607564 2026-02-17T08:29:48.494 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:29:48.494 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-73014444042 2026-02-17T08:29:48.495 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:29:48.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:29:48.497 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-73014444042 2026-02-17T08:29:48.497 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:29:48.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=73014444042 2026-02-17T08:29:48.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 73014444042' 2026-02-17T08:29:48.499 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 73014444042 2026-02-17T08:29:48.499 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:29:48.708 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 73014444043 -lt 73014444042 2026-02-17T08:29:48.708 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:29:48.709 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-103079215112 2026-02-17T08:29:48.709 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:29:48.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:29:48.711 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-103079215112 2026-02-17T08:29:48.711 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:29:48.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=103079215112 2026-02-17T08:29:48.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 103079215112' 2026-02-17T08:29:48.713 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 103079215112 2026-02-17T08:29:48.714 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:29:48.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 103079215113 -lt 103079215112 2026-02-17T08:29:48.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:29:48.906 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-137438953479 2026-02-17T08:29:48.906 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:29:48.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:29:48.908 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-137438953479 2026-02-17T08:29:48.908 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:29:48.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=137438953479 2026-02-17T08:29:48.910 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.4 seq 137438953479 2026-02-17T08:29:48.911 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 137438953479' 2026-02-17T08:29:48.911 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:29:49.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 137438953479 -lt 137438953479 2026-02-17T08:29:49.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:29:49.120 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 5-176093659141 2026-02-17T08:29:49.120 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:29:49.121 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=5 2026-02-17T08:29:49.122 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 5-176093659141 2026-02-17T08:29:49.122 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:29:49.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=176093659141 2026-02-17T08:29:49.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.5 seq 176093659141' 2026-02-17T08:29:49.124 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.5 seq 176093659141 2026-02-17T08:29:49.124 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T08:29:49.336 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 176093659141 -lt 176093659141 2026-02-17T08:29:49.336 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:29:49.337 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 6-210453397507 2026-02-17T08:29:49.337 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:29:49.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=6 2026-02-17T08:29:49.339 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 6-210453397507 2026-02-17T08:29:49.339 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:29:49.340 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=210453397507 2026-02-17T08:29:49.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.6 seq 210453397507' 2026-02-17T08:29:49.341 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.6 seq 210453397507 2026-02-17T08:29:49.341 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T08:29:49.538 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 210453397507 -lt 210453397507 2026-02-17T08:29:49.538 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:29:49.539 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:29:49.539 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:29:49.800 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:29:49.801 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:29:49.801 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:29:49.802 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:29:49.802 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:29:49.802 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:29:49.802 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:29:49.802 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:29:49.999 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:29:49.999 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:29:50.000 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:29:50.000 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:29:50.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:29:50.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:29:50.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:29:50.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:398: TEST_ec_single_recovery_error: rados_put td/test-erasure-eio pool-jerasure myobject 2026-02-17T08:29:50.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-17T08:29:50.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-17T08:29:50.260 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=myobject 2026-02-17T08:29:50.260 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:29:50.260 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-17T08:29:50.260 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:29:50.260 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-17T08:29:50.260 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:29:50.260 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-17T08:29:50.260 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:29:50.260 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-17T08:29:50.260 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put myobject td/test-erasure-eio/ORIGINAL 2026-02-17T08:29:50.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:399: TEST_ec_single_recovery_error: inject_eio ec data pool-jerasure myobject td/test-erasure-eio 0 2026-02-17T08:29:50.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2457: inject_eio: local pooltype=ec 2026-02-17T08:29:50.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2458: inject_eio: shift 2026-02-17T08:29:50.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2459: inject_eio: local which=data 2026-02-17T08:29:50.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2460: inject_eio: shift 2026-02-17T08:29:50.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2461: inject_eio: local poolname=pool-jerasure 2026-02-17T08:29:50.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2462: inject_eio: shift 2026-02-17T08:29:50.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2463: inject_eio: local objname=myobject 2026-02-17T08:29:50.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2464: inject_eio: shift 2026-02-17T08:29:50.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2465: inject_eio: local dir=td/test-erasure-eio 2026-02-17T08:29:50.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2466: inject_eio: shift 2026-02-17T08:29:50.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2467: inject_eio: local shard_id=0 2026-02-17T08:29:50.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2468: inject_eio: shift 2026-02-17T08:29:50.279 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: get_osds pool-jerasure myobject 2026-02-17T08:29:50.279 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:29:50.279 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=myobject 2026-02-17T08:29:50.280 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-17T08:29:50.280 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:29:50.480 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:29:50.480 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:29:50.480 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:29:50.480 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:29:50.480 INFO:tasks.workunit.client.0.trial059.stderr:6' 2026-02-17T08:29:50.481 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 5 1 0 6 2026-02-17T08:29:50.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: initial_osds=('3' '5' '1' '0' '6') 2026-02-17T08:29:50.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: local -a initial_osds 2026-02-17T08:29:50.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2471: inject_eio: local osd_id=3 2026-02-17T08:29:50.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2472: inject_eio: '[' ec '!=' ec ']' 2026-02-17T08:29:50.481 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: cat td/test-erasure-eio/3/type 2026-02-17T08:29:50.483 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: type=bluestore 2026-02-17T08:29:50.483 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2476: inject_eio: set_config osd 3 bluestore_debug_inject_read_err true 2026-02-17T08:29:50.483 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1161: set_config: local daemon=osd 2026-02-17T08:29:50.483 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1162: set_config: local id=3 2026-02-17T08:29:50.483 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1163: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T08:29:50.483 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1164: set_config: local value=true 2026-02-17T08:29:50.483 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: jq 'has("success")' 2026-02-17T08:29:50.483 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: get_asok_path osd.3 2026-02-17T08:29:50.483 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2026-02-17T08:29:50.484 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2026-02-17T08:29:50.484 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:29:50.484 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:29:50.484 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:29:50.484 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.3.asok 2026-02-17T08:29:50.485 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.70936/ceph-osd.3.asok config set bluestore_debug_inject_read_err true 2026-02-17T08:29:50.543 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: test true == true 2026-02-17T08:29:50.544 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2477: inject_eio: local loop=0 2026-02-17T08:29:50.545 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2479: inject_eio: grep -q Invalid 2026-02-17T08:29:50.545 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: get_asok_path osd.3 2026-02-17T08:29:50.545 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2026-02-17T08:29:50.545 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2026-02-17T08:29:50.545 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:29:50.545 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:29:50.545 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:29:50.546 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.3.asok 2026-02-17T08:29:50.546 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: CEPH_ARGS= 2026-02-17T08:29:50.546 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.3.asok injectdataerr pool-jerasure myobject 0 2026-02-17T08:29:50.604 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:401: TEST_ec_single_recovery_error: get_osds pool-jerasure myobject 2026-02-17T08:29:50.605 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:29:50.605 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=myobject 2026-02-17T08:29:50.605 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure myobject 2026-02-17T08:29:50.605 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:29:50.804 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:29:50.805 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:29:50.805 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:29:50.805 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:29:50.805 INFO:tasks.workunit.client.0.trial059.stderr:6' 2026-02-17T08:29:50.805 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 5 1 0 6 2026-02-17T08:29:50.805 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:401: TEST_ec_single_recovery_error: initial_osds=('3' '5' '1' '0' '6') 2026-02-17T08:29:50.805 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:401: TEST_ec_single_recovery_error: local -a initial_osds 2026-02-17T08:29:50.805 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:402: TEST_ec_single_recovery_error: local last_osd=6 2026-02-17T08:29:50.805 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:404: TEST_ec_single_recovery_error: kill_daemons td/test-erasure-eio TERM osd.6 2026-02-17T08:29:50.805 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:29:50.805 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:29:50.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:29:50.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:29:50.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:29:52.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:29:52.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:405: TEST_ec_single_recovery_error: ceph osd down 6 2026-02-17T08:29:52.312 INFO:tasks.workunit.client.0.trial059.stderr:osd.6 is already down. 2026-02-17T08:29:52.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:406: TEST_ec_single_recovery_error: ceph osd out 6 2026-02-17T08:29:52.586 INFO:tasks.workunit.client.0.trial059.stderr:osd.6 is already out. 2026-02-17T08:29:52.596 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:409: TEST_ec_single_recovery_error: wait_for_clean 2026-02-17T08:29:52.596 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:29:52.596 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:29:52.596 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:29:52.596 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:29:52.597 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:29:52.597 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:29:52.597 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:29:52.597 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:29:52.597 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:29:52.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:29:52.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:29:52.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:29:52.708 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:29:52.708 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:29:52.708 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:29:52.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:29:52.906 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:29:52.907 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:29:52.907 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:29:52.907 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:29:52.907 INFO:tasks.workunit.client.0.trial059.stderr:5 2026-02-17T08:29:52.907 INFO:tasks.workunit.client.0.trial059.stderr:6' 2026-02-17T08:29:52.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:29:52.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:29:52.907 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:29:52.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803793 2026-02-17T08:29:52.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803793 2026-02-17T08:29:52.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793' 2026-02-17T08:29:52.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:29:52.982 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:29:53.058 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=51539607567 2026-02-17T08:29:53.058 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 51539607567 2026-02-17T08:29:53.058 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607567' 2026-02-17T08:29:53.058 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:29:53.059 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:29:53.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=73014444046 2026-02-17T08:29:53.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 73014444046 2026-02-17T08:29:53.134 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607567 2-73014444046' 2026-02-17T08:29:53.134 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:29:53.134 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:29:53.212 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=103079215116 2026-02-17T08:29:53.212 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 103079215116 2026-02-17T08:29:53.212 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607567 2-73014444046 3-103079215116' 2026-02-17T08:29:53.212 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:29:53.213 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2026-02-17T08:29:53.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=137438953482 2026-02-17T08:29:53.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 137438953482 2026-02-17T08:29:53.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607567 2-73014444046 3-103079215116 4-137438953482' 2026-02-17T08:29:53.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:29:53.289 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2026-02-17T08:29:53.364 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=176093659144 2026-02-17T08:29:53.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 176093659144 2026-02-17T08:29:53.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-51539607567 2-73014444046 3-103079215116 4-137438953482 5-176093659144' 2026-02-17T08:29:53.365 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:29:53.365 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2026-02-17T08:29:53.420 INFO:tasks.workunit.client.0.trial059.stderr:Error ENXIO: problem getting command descriptions from osd.6 2026-02-17T08:29:53.422 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq= 2026-02-17T08:29:53.422 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z '' 2026-02-17T08:29:53.422 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: continue 2026-02-17T08:29:53.422 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:29:53.423 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803793 2026-02-17T08:29:53.423 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:29:53.423 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:29:53.424 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803793 2026-02-17T08:29:53.425 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:29:53.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803793 2026-02-17T08:29:53.426 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 25769803793 2026-02-17T08:29:53.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803793' 2026-02-17T08:29:53.427 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:29:53.622 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803791 -lt 25769803793 2026-02-17T08:29:53.622 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:29:54.623 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:29:54.624 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:29:54.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803793 -lt 25769803793 2026-02-17T08:29:54.821 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:29:54.822 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-51539607567 2026-02-17T08:29:54.822 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:29:54.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:29:54.824 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-51539607567 2026-02-17T08:29:54.824 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:29:54.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=51539607567 2026-02-17T08:29:54.826 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 51539607567 2026-02-17T08:29:54.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 51539607567' 2026-02-17T08:29:54.827 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:29:55.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 51539607568 -lt 51539607567 2026-02-17T08:29:55.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:29:55.039 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-73014444046 2026-02-17T08:29:55.039 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:29:55.040 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:29:55.041 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-73014444046 2026-02-17T08:29:55.041 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:29:55.042 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=73014444046 2026-02-17T08:29:55.043 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 73014444046 2026-02-17T08:29:55.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 73014444046' 2026-02-17T08:29:55.043 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:29:55.245 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 73014444046 -lt 73014444046 2026-02-17T08:29:55.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:29:55.246 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-103079215116 2026-02-17T08:29:55.246 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:29:55.247 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:29:55.248 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-103079215116 2026-02-17T08:29:55.248 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:29:55.250 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=103079215116 2026-02-17T08:29:55.250 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 103079215116 2026-02-17T08:29:55.251 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 103079215116' 2026-02-17T08:29:55.251 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:29:55.450 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 103079215116 -lt 103079215116 2026-02-17T08:29:55.450 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:29:55.451 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 4-137438953482 2026-02-17T08:29:55.451 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:29:55.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=4 2026-02-17T08:29:55.453 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 4-137438953482 2026-02-17T08:29:55.453 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:29:55.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=137438953482 2026-02-17T08:29:55.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.4 seq 137438953482' 2026-02-17T08:29:55.455 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.4 seq 137438953482 2026-02-17T08:29:55.455 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T08:29:55.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 137438953482 -lt 137438953482 2026-02-17T08:29:55.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:29:55.661 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 5-176093659144 2026-02-17T08:29:55.661 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:29:55.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=5 2026-02-17T08:29:55.663 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 5-176093659144 2026-02-17T08:29:55.663 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:29:55.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=176093659144 2026-02-17T08:29:55.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.5 seq 176093659144' 2026-02-17T08:29:55.664 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.5 seq 176093659144 2026-02-17T08:29:55.665 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T08:29:55.863 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 176093659144 -lt 176093659144 2026-02-17T08:29:55.864 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:29:55.864 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:29:55.864 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:29:56.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:29:56.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:29:56.127 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:29:56.127 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:29:56.127 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:29:56.127 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:29:56.128 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:29:56.128 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:29:56.319 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=4 2026-02-17T08:29:56.320 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:29:56.320 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:29:56.321 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:29:56.574 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 4 = 5 2026-02-17T08:29:56.574 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 4 '!=' -1 2026-02-17T08:29:56.574 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: loop=0 2026-02-17T08:29:56.574 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: num_active_clean=4 2026-02-17T08:29:56.574 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T08:29:56.574 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.1 2026-02-17T08:29:56.675 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T08:29:56.676 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:29:56.677 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:29:56.677 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:29:56.677 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:29:56.677 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:29:56.677 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:29:56.677 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:29:56.870 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=4 2026-02-17T08:29:56.871 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:29:56.871 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:29:56.871 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:29:57.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 4 = 5 2026-02-17T08:29:57.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 4 '!=' 4 2026-02-17T08:29:57.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T08:29:57.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T08:29:57.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T08:29:57.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T08:29:57.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T08:29:57.123 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T08:29:57.123 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T08:29:57.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T08:29:57.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T08:29:57.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 1 >= 13 )) 2026-02-17T08:29:57.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T08:29:57.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.2 2026-02-17T08:29:57.578 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T08:29:57.578 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:29:57.579 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:29:57.580 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:29:57.580 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:29:57.580 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:29:57.580 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:29:57.580 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:29:57.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=4 2026-02-17T08:29:57.771 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:29:57.771 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:29:57.771 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:29:58.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 4 = 5 2026-02-17T08:29:58.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 4 '!=' 4 2026-02-17T08:29:58.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T08:29:58.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T08:29:58.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T08:29:58.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T08:29:58.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T08:29:58.023 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T08:29:58.023 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T08:29:58.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=682 2026-02-17T08:29:58.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test 682 '!=' null 2026-02-17T08:29:58.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1677: wait_for_clean: loop=0 2026-02-17T08:29:58.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T08:29:58.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.1 2026-02-17T08:29:58.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T08:29:58.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:29:58.381 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:29:58.381 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:29:58.381 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:29:58.381 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:29:58.382 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:29:58.382 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:29:58.576 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:29:58.576 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:29:58.577 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:29:58.577 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:29:58.837 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:29:58.837 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:29:58.837 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:29:58.837 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:411: TEST_ec_single_recovery_error: rados_get td/test-erasure-eio pool-jerasure myobject 2026-02-17T08:29:58.837 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:29:58.837 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:29:58.837 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=myobject 2026-02-17T08:29:58.837 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-17T08:29:58.837 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-17T08:29:58.837 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get myobject td/test-erasure-eio/COPY 2026-02-17T08:29:58.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-17T08:29:58.856 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-17T08:29:58.857 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:413: TEST_ec_single_recovery_error: delete_erasure_coded_pool pool-jerasure 2026-02-17T08:29:58.858 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:29:58.858 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-17T08:29:59.046 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' does not exist 2026-02-17T08:29:59.055 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-17T08:29:59.314 INFO:tasks.workunit.client.0.trial059.stderr:erasure-code-profile myprofile does not exist 2026-02-17T08:29:59.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-17T08:29:59.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:29:59.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:29:59.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:29:59.324 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:29:59.324 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:29:59.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:29:59.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:29:59.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:29:59.637 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:29:59.638 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:29:59.639 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:29:59.640 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:29:59.641 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:29:59.641 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:29:59.642 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:29:59.643 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:29:59.643 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:29:59.644 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:29:59.644 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:29:59.645 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:29:59.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:29:59.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:29:59.669 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:29:59.669 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:29:59.669 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:29:59.669 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:29:59.671 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:29:59.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:29:59.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-17T08:29:59.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-17T08:29:59.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-eio 2026-02-17T08:29:59.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-eio 2026-02-17T08:29:59.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:29:59.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:29:59.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:29:59.672 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:29:59.672 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:29:59.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:29:59.673 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:29:59.673 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:29:59.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:29:59.674 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:29:59.675 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:29:59.675 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:29:59.677 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:29:59.677 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:29:59.677 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:29:59.678 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:29:59.678 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:29:59.679 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:29:59.679 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:29:59.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:29:59.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:29:59.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:29:59.683 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:29:59.683 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:29:59.683 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:29:59.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:29:59.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:29:59.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:29:59.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-eio 2026-02-17T08:29:59.686 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:29:59.686 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:29:59.686 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:29:59.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.70936 2026-02-17T08:29:59.688 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:29:59.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:29:59.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:29:59.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-17T08:29:59.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-17T08:29:59.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-eio 2026-02-17T08:29:59.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:29:59.690 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:29:59.690 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:29:59.690 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-eio/a 2026-02-17T08:29:59.690 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-17T08:29:59.710 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:29:59.710 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:29:59.710 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:29:59.710 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:29:59.711 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:29:59.711 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:29:59.711 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:29:59.711 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T08:29:59.738 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:29:59.739 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:29:59.740 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:29:59.740 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:29:59.740 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:29:59.741 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:29:59.741 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:29:59.741 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:29:59.741 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:29:59.742 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:29:59.742 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:29:59.742 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:29:59.742 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:29:59.742 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:29:59.742 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get fsid 2026-02-17T08:29:59.796 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:29:59.796 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:29:59.796 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:29:59.796 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:29:59.797 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:29:59.797 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:29:59.797 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:29:59.798 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:29:59.798 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:29:59.798 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:29:59.798 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:29:59.798 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:29:59.798 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:29:59.799 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get mon_host 2026-02-17T08:29:59.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-17T08:29:59.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-eio 2026-02-17T08:29:59.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:29:59.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:29:59.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:29:59.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-eio/x 2026-02-17T08:29:59.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:29:59.959 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:29:59.959 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:29:59.959 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:29:59.960 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:29:59.960 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:29:59.960 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:29:59.960 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:29:59.961 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:29:59.962 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:29:59.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-17T08:29:59.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T08:30:00.097 INFO:tasks.workunit.client.0.trial059.stderr:pool 'rbd' already exists 2026-02-17T08:30:00.105 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:30:01.108 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-17T08:30:01.108 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:30:01.108 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:30:01.108 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:30:01.109 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:30:01.109 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:30:01.109 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:30:01.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-17T08:30:01.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-mon.a.asok log flush 2026-02-17T08:30:01.158 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:30:01.163 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-17T08:30:01.165 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:29:59.713+0000 7f1633074ec0 0 load: jerasure load: lrc 2026-02-17T08:30:01.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_rados_get_bad_size_shard_0 td/test-erasure-eio 2026-02-17T08:30:01.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:302: TEST_rados_get_bad_size_shard_0: local dir=td/test-erasure-eio 2026-02-17T08:30:01.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:303: TEST_rados_get_bad_size_shard_0: setup_osds 4 2026-02-17T08:30:01.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=4 2026-02-17T08:30:01.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-17T08:30:01.167 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 4 - 1 2026-02-17T08:30:01.167 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 3 2026-02-17T08:30:01.170 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:30:01.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-17T08:30:01.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:30:01.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:30:01.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:30:01.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:30:01.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-17T08:30:01.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:30:01.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:30:01.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:30:01.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:30:01.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-17T08:30:01.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-17T08:30:01.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:30:01.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:30:01.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:30:01.172 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:30:01.172 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:30:01.172 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:30:01.172 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:30:01.172 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:30:01.172 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:30:01.172 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:30:01.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:30:01.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:30:01.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:30:01.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:30:01.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:30:01.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:30:01.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:30:01.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:30:01.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:30:01.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:30:01.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:30:01.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:30:01.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-17T08:30:01.174 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:30:01.174 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=659e1632-487d-4a27-810c-3fd65bacd9fc 2026-02-17T08:30:01.174 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 659e1632-487d-4a27-810c-3fd65bacd9fc' 2026-02-17T08:30:01.175 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 659e1632-487d-4a27-810c-3fd65bacd9fc 2026-02-17T08:30:01.175 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:30:01.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAJJ5RpIBgWChAASikK4b9mq4TXvc1bCYpCbA== 2026-02-17T08:30:01.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAJJ5RpIBgWChAASikK4b9mq4TXvc1bCYpCbA=="}' 2026-02-17T08:30:01.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 659e1632-487d-4a27-810c-3fd65bacd9fc -i td/test-erasure-eio/0/new.json 2026-02-17T08:30:01.295 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:30:01.302 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-17T08:30:01.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAJJ5RpIBgWChAASikK4b9mq4TXvc1bCYpCbA== --osd-uuid 659e1632-487d-4a27-810c-3fd65bacd9fc 2026-02-17T08:30:01.318 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:01.301+0000 7fa374d918c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:01.320 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:01.301+0000 7fa374d918c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:01.321 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:01.305+0000 7fa374d918c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:01.321 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:01.305+0000 7fa374d918c0 -1 bdev(0x56367bf19c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:30:01.321 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:01.305+0000 7fa374d918c0 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-17T08:30:03.878 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-17T08:30:03.878 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:30:03.879 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:30:03.879 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:30:03.880 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:30:04.146 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:30:04.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:30:04.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:30:04.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:30:04.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:30:04.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:30:04.169 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:04.153+0000 7fa84904a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:04.171 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:04.153+0000 7fa84904a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:04.172 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:04.157+0000 7fa84904a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:04.345 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:30:04.346 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:30:04.346 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:30:04.346 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:30:04.346 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:30:04.346 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:04.346 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:30:04.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:30:04.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:04.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:30:04.543 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:05.544 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:05.544 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:05.545 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:30:05.545 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:30:05.545 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:05.546 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:30:05.739 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:05.950 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:05.933+0000 7fa84904a8c0 -1 Falling back to public interface 2026-02-17T08:30:06.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:06.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:06.740 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:30:06.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:30:06.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:06.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:30:06.937 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:07.938 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:07.939 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:07.939 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:30:07.939 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:30:07.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:07.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:30:08.130 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:08.969 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:08.953+0000 7fa84904a8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:30:09.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:09.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:09.132 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:30:09.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:30:09.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:09.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:30:09.329 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:10.330 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:10.330 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:10.330 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:30:10.330 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:30:10.330 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:10.330 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:30:10.524 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3629495219,v1:127.0.0.1:6803/3629495219] [v2:127.0.0.1:6804/3629495219,v1:127.0.0.1:6805/3629495219] exists,up 659e1632-487d-4a27-810c-3fd65bacd9fc 2026-02-17T08:30:10.528 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:30:10.528 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:30:10.528 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:30:10.528 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:30:10.528 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-17T08:30:10.529 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:30:10.529 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:30:10.529 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T08:30:10.529 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:30:10.529 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-17T08:30:10.529 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:30:10.529 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:30:10.529 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:30:10.529 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:30:10.529 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-17T08:30:10.529 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-17T08:30:10.530 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:30:10.530 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:30:10.530 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:30:10.530 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:30:10.530 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:30:10.530 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:30:10.530 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:30:10.530 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:30:10.530 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:30:10.530 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:30:10.530 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:30:10.530 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:30:10.530 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:30:10.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:30:10.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:30:10.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:30:10.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:30:10.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:30:10.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:30:10.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:30:10.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:30:10.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:30:10.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-17T08:30:10.532 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:30:10.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=3aa1ea6e-25cd-413e-9c15-7ab4f137ba65 2026-02-17T08:30:10.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 3aa1ea6e-25cd-413e-9c15-7ab4f137ba65' 2026-02-17T08:30:10.533 INFO:tasks.workunit.client.0.trial059.stdout:add osd1 3aa1ea6e-25cd-413e-9c15-7ab4f137ba65 2026-02-17T08:30:10.533 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:30:10.542 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQASJ5Rp389lHxAABlEg7F9jRnIjTHSSDFjnSQ== 2026-02-17T08:30:10.542 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQASJ5Rp389lHxAABlEg7F9jRnIjTHSSDFjnSQ=="}' 2026-02-17T08:30:10.542 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 3aa1ea6e-25cd-413e-9c15-7ab4f137ba65 -i td/test-erasure-eio/1/new.json 2026-02-17T08:30:10.745 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:30:10.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-17T08:30:10.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQASJ5Rp389lHxAABlEg7F9jRnIjTHSSDFjnSQ== --osd-uuid 3aa1ea6e-25cd-413e-9c15-7ab4f137ba65 2026-02-17T08:30:10.772 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:10.753+0000 7fb0d63fd8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:10.773 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:10.757+0000 7fb0d63fd8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:10.774 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:10.757+0000 7fb0d63fd8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:10.774 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:10.757+0000 7fb0d63fd8c0 -1 bdev(0x563f6b9a1c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-17T08:30:10.775 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:10.757+0000 7fb0d63fd8c0 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-17T08:30:13.037 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-17T08:30:13.037 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:30:13.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T08:30:13.038 INFO:tasks.workunit.client.0.trial059.stdout:adding osd1 key to auth repository 2026-02-17T08:30:13.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:30:13.309 INFO:tasks.workunit.client.0.trial059.stdout:start osd.1 2026-02-17T08:30:13.310 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T08:30:13.310 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:30:13.310 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:30:13.310 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:30:13.310 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:30:13.331 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:13.313+0000 7faaff9bd8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:13.332 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:13.317+0000 7faaff9bd8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:13.333 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:13.317+0000 7faaff9bd8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:13.511 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T08:30:13.511 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:30:13.511 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:30:13.511 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:30:13.511 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:30:13.511 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:13.512 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:30:13.512 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:30:13.512 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:13.513 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:30:13.708 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:14.709 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:14.709 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:14.709 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:30:14.709 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:30:14.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:14.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:30:14.850 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:14.833+0000 7faaff9bd8c0 -1 Falling back to public interface 2026-02-17T08:30:14.903 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:15.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:15.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:15.904 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:30:15.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:30:15.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:15.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:30:16.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:17.098 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:17.098 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:17.098 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:30:17.099 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:30:17.099 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:17.099 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:30:17.293 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:17.824 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:17.805+0000 7faaff9bd8c0 -1 osd.1 0 log_to_monitors true 2026-02-17T08:30:18.295 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:18.295 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:18.295 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:30:18.296 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:30:18.296 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:18.296 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:30:18.494 INFO:tasks.workunit.client.0.trial059.stdout:osd.1 up in weight 1 up_from 12 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1283102590,v1:127.0.0.1:6811/1283102590] [v2:127.0.0.1:6812/1283102590,v1:127.0.0.1:6813/1283102590] exists,up 3aa1ea6e-25cd-413e-9c15-7ab4f137ba65 2026-02-17T08:30:18.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:30:18.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:30:18.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:30:18.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:30:18.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-17T08:30:18.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:30:18.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:30:18.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T08:30:18.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:30:18.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-17T08:30:18.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:30:18.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:30:18.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:30:18.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:30:18.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-17T08:30:18.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-17T08:30:18.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:30:18.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:30:18.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:30:18.496 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:30:18.496 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:30:18.496 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:30:18.496 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:30:18.497 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:30:18.497 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:30:18.497 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:30:18.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:30:18.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:30:18.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:30:18.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:30:18.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:30:18.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:30:18.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:30:18.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:30:18.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:30:18.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:30:18.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:30:18.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:30:18.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-17T08:30:18.498 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:30:18.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=5f95cb07-ef36-4432-92a5-bd40ca07fd1f 2026-02-17T08:30:18.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 5f95cb07-ef36-4432-92a5-bd40ca07fd1f' 2026-02-17T08:30:18.499 INFO:tasks.workunit.client.0.trial059.stdout:add osd2 5f95cb07-ef36-4432-92a5-bd40ca07fd1f 2026-02-17T08:30:18.500 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:30:18.511 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAaJ5Rp3sWWHRAABIxETSUeQMA3hT/noJeE8Q== 2026-02-17T08:30:18.511 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAaJ5Rp3sWWHRAABIxETSUeQMA3hT/noJeE8Q=="}' 2026-02-17T08:30:18.511 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 5f95cb07-ef36-4432-92a5-bd40ca07fd1f -i td/test-erasure-eio/2/new.json 2026-02-17T08:30:18.719 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:30:18.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-17T08:30:18.731 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAaJ5Rp3sWWHRAABIxETSUeQMA3hT/noJeE8Q== --osd-uuid 5f95cb07-ef36-4432-92a5-bd40ca07fd1f 2026-02-17T08:30:18.757 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:18.741+0000 7efd7c1db8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:18.758 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:18.741+0000 7efd7c1db8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:18.759 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:18.741+0000 7efd7c1db8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:18.760 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:18.741+0000 7efd7c1db8c0 -1 bdev(0x562f4aa11c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-17T08:30:18.760 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:18.741+0000 7efd7c1db8c0 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-17T08:30:21.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-17T08:30:21.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:30:21.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T08:30:21.023 INFO:tasks.workunit.client.0.trial059.stdout:adding osd2 key to auth repository 2026-02-17T08:30:21.024 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:30:21.291 INFO:tasks.workunit.client.0.trial059.stdout:start osd.2 2026-02-17T08:30:21.292 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T08:30:21.292 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:30:21.292 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:30:21.292 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:30:21.292 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:30:21.314 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:21.297+0000 7fa65a5998c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:21.316 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:21.297+0000 7fa65a5998c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:21.317 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:21.301+0000 7fa65a5998c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:21.489 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T08:30:21.489 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:30:21.489 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:30:21.489 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:30:21.489 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:30:21.489 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:21.489 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:30:21.490 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:30:21.490 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:21.490 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:30:21.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:22.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:22.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:22.685 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:30:22.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:30:22.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:22.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:30:22.838 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:22.821+0000 7fa65a5998c0 -1 Falling back to public interface 2026-02-17T08:30:22.884 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:23.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:23.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:23.886 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:30:23.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:30:23.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:23.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:30:24.082 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:25.084 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:25.084 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:25.084 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:30:25.084 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:30:25.084 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:25.084 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:30:25.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:26.056 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:26.037+0000 7fa65a5998c0 -1 osd.2 0 log_to_monitors true 2026-02-17T08:30:26.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:26.282 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:26.282 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:30:26.283 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:30:26.283 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:26.283 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:30:26.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:27.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:27.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:27.480 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:30:27.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:30:27.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:27.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:30:27.675 INFO:tasks.workunit.client.0.trial059.stdout:osd.2 up in weight 1 up_from 18 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1105889796,v1:127.0.0.1:6819/1105889796] [v2:127.0.0.1:6820/1105889796,v1:127.0.0.1:6821/1105889796] exists,up 5f95cb07-ef36-4432-92a5-bd40ca07fd1f 2026-02-17T08:30:27.679 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:30:27.679 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:30:27.679 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:30:27.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:30:27.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-17T08:30:27.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:30:27.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:30:27.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2026-02-17T08:30:27.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:30:27.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-17T08:30:27.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:30:27.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:30:27.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:30:27.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:30:27.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-17T08:30:27.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-17T08:30:27.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:30:27.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:30:27.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:30:27.681 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:30:27.681 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:30:27.681 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:30:27.681 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:30:27.681 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:30:27.681 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:30:27.681 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:30:27.682 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:30:27.682 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:30:27.682 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:30:27.682 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:30:27.682 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:30:27.682 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:30:27.682 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:30:27.682 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:30:27.682 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:30:27.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:30:27.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:30:27.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:30:27.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-17T08:30:27.683 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:30:27.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=bf942913-16e6-419a-9041-3cdd079b3c97 2026-02-17T08:30:27.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 bf942913-16e6-419a-9041-3cdd079b3c97' 2026-02-17T08:30:27.683 INFO:tasks.workunit.client.0.trial059.stdout:add osd3 bf942913-16e6-419a-9041-3cdd079b3c97 2026-02-17T08:30:27.684 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:30:27.691 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAjJ5RpqEVGKBAAbMM/evnOKEL+y6qED/oShg== 2026-02-17T08:30:27.691 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAjJ5RpqEVGKBAAbMM/evnOKEL+y6qED/oShg=="}' 2026-02-17T08:30:27.691 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new bf942913-16e6-419a-9041-3cdd079b3c97 -i td/test-erasure-eio/3/new.json 2026-02-17T08:30:27.892 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:30:27.901 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-17T08:30:27.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAjJ5RpqEVGKBAAbMM/evnOKEL+y6qED/oShg== --osd-uuid bf942913-16e6-419a-9041-3cdd079b3c97 2026-02-17T08:30:27.918 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:27.901+0000 7f3eca9dd8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:27.919 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:27.901+0000 7f3eca9dd8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:27.920 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:27.901+0000 7f3eca9dd8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:27.921 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:27.905+0000 7f3eca9dd8c0 -1 bdev(0x55af7d577c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-17T08:30:27.921 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:27.905+0000 7f3eca9dd8c0 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-17T08:30:30.206 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-17T08:30:30.206 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:30:30.207 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2026-02-17T08:30:30.207 INFO:tasks.workunit.client.0.trial059.stdout:adding osd3 key to auth repository 2026-02-17T08:30:30.207 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:30:30.474 INFO:tasks.workunit.client.0.trial059.stdout:start osd.3 2026-02-17T08:30:30.475 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2026-02-17T08:30:30.475 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:30:30.475 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:30:30.475 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:30:30.476 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:30:30.496 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:30.477+0000 7f20d9d758c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:30.498 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:30.481+0000 7f20d9d758c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:30.499 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:30.481+0000 7f20d9d758c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:30.675 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2026-02-17T08:30:30.675 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:30:30.675 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T08:30:30.675 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:30:30.675 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:30:30.675 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:30.675 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:30:30.676 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:30:30.676 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:30.676 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:30:30.872 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:31.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:31.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:31.873 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:30:31.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:30:31.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:31.874 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:30:31.998 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:31.981+0000 7f20d9d758c0 -1 Falling back to public interface 2026-02-17T08:30:32.067 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:33.068 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:33.068 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:33.068 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:30:33.069 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:30:33.069 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:33.069 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:30:33.269 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:34.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:34.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:34.271 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:30:34.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:30:34.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:34.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:30:34.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:34.981 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:34.965+0000 7f20d9d758c0 -1 osd.3 0 log_to_monitors true 2026-02-17T08:30:35.472 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:35.473 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:35.473 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:30:35.473 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:30:35.474 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:35.474 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:30:35.667 INFO:tasks.workunit.client.0.trial059.stdout:osd.3 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/641853453,v1:127.0.0.1:6827/641853453] [v2:127.0.0.1:6828/641853453,v1:127.0.0.1:6829/641853453] exists,up bf942913-16e6-419a-9041-3cdd079b3c97 2026-02-17T08:30:35.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:30:35.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:30:35.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:30:35.668 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-17T08:30:35.669 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:30:35.669 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:30:35.669 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:30:35.669 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:30:35.669 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:30:35.670 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.0.asok 2026-02-17T08:30:35.670 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-17T08:30:35.670 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.0.asok log flush 2026-02-17T08:30:35.726 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:30:35.732 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-17T08:30:35.734 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:30:05.937+0000 7fa84904a8c0 0 load: jerasure load: lrc 2026-02-17T08:30:35.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:305: TEST_rados_get_bad_size_shard_0: local poolname=pool-jerasure 2026-02-17T08:30:35.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:306: TEST_rados_get_bad_size_shard_0: create_erasure_coded_pool pool-jerasure 2 1 2026-02-17T08:30:35.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:30:35.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-17T08:30:35.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=2 2026-02-17T08:30:35.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-17T08:30:35.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=1 2026-02-17T08:30:35.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-17T08:30:35.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=2 m=1 crush-failure-domain=osd 2026-02-17T08:30:35.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-17T08:30:35.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-17T08:30:36.319 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' already exists 2026-02-17T08:30:36.328 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:30:37.330 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-17T08:30:37.330 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:30:37.330 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:30:37.330 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:30:37.330 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:30:37.331 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:30:37.332 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:30:37.332 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:30:37.332 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:30:37.332 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:30:37.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:30:37.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:30:37.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:30:37.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:30:37.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:30:37.435 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:30:37.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:30:37.633 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:30:37.633 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:30:37.633 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:30:37.634 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:30:37.634 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:30:37.634 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:30:37.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803785 2026-02-17T08:30:37.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803785 2026-02-17T08:30:37.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803785' 2026-02-17T08:30:37.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:30:37.707 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:30:37.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=51539607558 2026-02-17T08:30:37.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 51539607558 2026-02-17T08:30:37.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803785 1-51539607558' 2026-02-17T08:30:37.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:30:37.783 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:30:37.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411333 2026-02-17T08:30:37.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411333 2026-02-17T08:30:37.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803785 1-51539607558 2-77309411333' 2026-02-17T08:30:37.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:30:37.861 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:30:37.936 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=107374182403 2026-02-17T08:30:37.936 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 107374182403 2026-02-17T08:30:37.936 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803785 1-51539607558 2-77309411333 3-107374182403' 2026-02-17T08:30:37.936 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:30:37.936 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803785 2026-02-17T08:30:37.937 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:30:37.938 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:30:37.938 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803785 2026-02-17T08:30:37.939 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:30:37.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803785 2026-02-17T08:30:37.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803785' 2026-02-17T08:30:37.940 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 25769803785 2026-02-17T08:30:37.940 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:30:38.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803783 -lt 25769803785 2026-02-17T08:30:38.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:30:39.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:30:39.143 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:30:39.345 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803785 -lt 25769803785 2026-02-17T08:30:39.345 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:30:39.346 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-51539607558 2026-02-17T08:30:39.346 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:30:39.348 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:30:39.348 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-51539607558 2026-02-17T08:30:39.348 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:30:39.350 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=51539607558 2026-02-17T08:30:39.350 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 51539607558' 2026-02-17T08:30:39.350 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 51539607558 2026-02-17T08:30:39.351 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:30:39.546 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 51539607558 -lt 51539607558 2026-02-17T08:30:39.547 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:30:39.547 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-77309411333 2026-02-17T08:30:39.547 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:30:39.548 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:30:39.549 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-77309411333 2026-02-17T08:30:39.549 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:30:39.551 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411333 2026-02-17T08:30:39.551 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 77309411333' 2026-02-17T08:30:39.551 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 77309411333 2026-02-17T08:30:39.551 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:30:39.760 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411333 -lt 77309411333 2026-02-17T08:30:39.760 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:30:39.761 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-107374182403 2026-02-17T08:30:39.761 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:30:39.762 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:30:39.763 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-107374182403 2026-02-17T08:30:39.763 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:30:39.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=107374182403 2026-02-17T08:30:39.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 107374182403' 2026-02-17T08:30:39.765 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 107374182403 2026-02-17T08:30:39.765 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:30:39.962 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 107374182403 -lt 107374182403 2026-02-17T08:30:39.963 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:30:39.963 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:30:39.963 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:30:40.216 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:30:40.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:30:40.217 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:30:40.217 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:30:40.217 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:30:40.217 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:30:40.218 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:30:40.218 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:30:40.406 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:30:40.406 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:30:40.407 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:30:40.407 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:30:40.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:30:40.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:30:40.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:30:40.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:308: TEST_rados_get_bad_size_shard_0: local shard_id=0 2026-02-17T08:30:40.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:309: TEST_rados_get_bad_size_shard_0: rados_get_data_bad_size td/test-erasure-eio 0 10 2026-02-17T08:30:40.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:222: rados_get_data_bad_size: local dir=td/test-erasure-eio 2026-02-17T08:30:40.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:223: rados_get_data_bad_size: shift 2026-02-17T08:30:40.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:224: rados_get_data_bad_size: local shard_id=0 2026-02-17T08:30:40.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:225: rados_get_data_bad_size: shift 2026-02-17T08:30:40.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: rados_get_data_bad_size: local bytes=10 2026-02-17T08:30:40.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: rados_get_data_bad_size: shift 2026-02-17T08:30:40.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: rados_get_data_bad_size: local mode=set 2026-02-17T08:30:40.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:230: rados_get_data_bad_size: local poolname=pool-jerasure 2026-02-17T08:30:40.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:231: rados_get_data_bad_size: local objname=obj-size-70936-0-10 2026-02-17T08:30:40.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:232: rados_get_data_bad_size: rados_put td/test-erasure-eio pool-jerasure obj-size-70936-0-10 2026-02-17T08:30:40.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-17T08:30:40.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-17T08:30:40.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-size-70936-0-10 2026-02-17T08:30:40.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:30:40.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-17T08:30:40.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:30:40.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-17T08:30:40.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:30:40.665 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-17T08:30:40.665 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:30:40.665 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-17T08:30:40.665 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-size-70936-0-10 td/test-erasure-eio/ORIGINAL 2026-02-17T08:30:40.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:236: rados_get_data_bad_size: set_size obj-size-70936-0-10 td/test-erasure-eio 0 10 set 2026-02-17T08:30:40.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:192: set_size: local objname=obj-size-70936-0-10 2026-02-17T08:30:40.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:193: set_size: shift 2026-02-17T08:30:40.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:194: set_size: local dir=td/test-erasure-eio 2026-02-17T08:30:40.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:195: set_size: shift 2026-02-17T08:30:40.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:196: set_size: local shard_id=0 2026-02-17T08:30:40.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:197: set_size: shift 2026-02-17T08:30:40.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:198: set_size: local bytes=10 2026-02-17T08:30:40.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:199: set_size: shift 2026-02-17T08:30:40.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:200: set_size: local mode=set 2026-02-17T08:30:40.680 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local poolname=pool-jerasure 2026-02-17T08:30:40.680 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: get_osds pool-jerasure obj-size-70936-0-10 2026-02-17T08:30:40.680 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:30:40.680 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj-size-70936-0-10 2026-02-17T08:30:40.680 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj-size-70936-0-10 2026-02-17T08:30:40.680 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:30:40.880 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:30:40.880 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:30:40.880 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:30:40.880 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 2 2026-02-17T08:30:40.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: initial_osds=('3' '1' '2') 2026-02-17T08:30:40.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: local -a initial_osds 2026-02-17T08:30:40.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local osd_id=3 2026-02-17T08:30:40.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: ceph osd set noout 2026-02-17T08:30:41.129 INFO:tasks.workunit.client.0.trial059.stderr:noout is set 2026-02-17T08:30:41.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: '[' set = add ']' 2026-02-17T08:30:41.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: '[' 10 = 0 ']' 2026-02-17T08:30:41.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: dd if=/dev/urandom bs=10 count=1 of=td/test-erasure-eio/CORRUPT 2026-02-17T08:30:41.142 INFO:tasks.workunit.client.0.trial059.stderr:1+0 records in 2026-02-17T08:30:41.142 INFO:tasks.workunit.client.0.trial059.stderr:1+0 records out 2026-02-17T08:30:41.142 INFO:tasks.workunit.client.0.trial059.stderr:10 bytes copied, 4.1156e-05 s, 243 kB/s 2026-02-17T08:30:41.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: objectstore_tool td/test-erasure-eio 3 obj-size-70936-0-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:30:41.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1297: objectstore_tool: local dir=td/test-erasure-eio 2026-02-17T08:30:41.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: objectstore_tool: shift 2026-02-17T08:30:41.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1299: objectstore_tool: local id=3 2026-02-17T08:30:41.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: objectstore_tool: shift 2026-02-17T08:30:41.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 3 obj-size-70936-0-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:30:41.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-17T08:30:41.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2026-02-17T08:30:41.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=3 2026-02-17T08:30:41.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2026-02-17T08:30:41.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.3 2026-02-17T08:30:41.143 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:30:41.143 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:30:41.144 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:30:41.144 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:30:41.144 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:30:42.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:30:42.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 3 obj-size-70936-0-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:30:42.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-17T08:30:42.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T08:30:42.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=3 2026-02-17T08:30:42.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T08:30:42.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/3 2026-02-17T08:30:42.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/3 obj-size-70936-0-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:30:43.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 3 2026-02-17T08:30:43.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-eio 2026-02-17T08:30:43.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:30:43.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=3 2026-02-17T08:30:43.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:30:43.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-eio/3 2026-02-17T08:30:43.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:30:43.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:30:43.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:30:43.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:30:43.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-17T08:30:43.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-17T08:30:43.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:30:43.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:30:43.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:30:43.656 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:30:43.656 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:30:43.656 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:30:43.656 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:30:43.657 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:30:43.657 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:30:43.658 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:30:43.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:30:43.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:30:43.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:30:43.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:30:43.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:30:43.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:30:43.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:30:43.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:30:43.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:30:43.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:30:43.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-eio/3 2026-02-17T08:30:43.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.3 2026-02-17T08:30:43.659 INFO:tasks.workunit.client.0.trial059.stderr:start osd.3 2026-02-17T08:30:43.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:30:43.660 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-eio/3/whoami 2026-02-17T08:30:43.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 3 = 3 ']' 2026-02-17T08:30:43.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:30:43.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:30:43.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:30:43.675 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:43.657+0000 7f8f5587d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:43.677 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:43.661+0000 7f8f5587d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:43.678 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:43.661+0000 7f8f5587d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:43.860 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 3 2026-02-17T08:30:43.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:30:43.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T08:30:43.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:30:43.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:30:43.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:43.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:30:43.861 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:30:43.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:43.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:30:44.057 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:44.930 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:44.912+0000 7f8f5587d8c0 -1 Falling back to public interface 2026-02-17T08:30:45.058 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:45.058 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:45.058 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:30:45.058 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:30:45.058 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:45.058 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:30:45.253 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:46.254 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:46.254 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:46.254 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:30:46.255 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:30:46.255 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:46.255 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:30:46.450 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:47.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:47.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:47.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:30:47.452 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:30:47.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:47.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:30:47.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:48.009 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:47.992+0000 7f8f5587d8c0 -1 osd.3 34 log_to_monitors true 2026-02-17T08:30:48.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:48.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:48.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:30:48.650 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:30:48.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:48.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:30:48.843 INFO:tasks.workunit.client.0.trial059.stderr:osd.3 up in weight 1 up_from 38 up_thru 38 down_at 35 last_clean_interval [25,34) [v2:127.0.0.1:6826/3583639224,v1:127.0.0.1:6827/3583639224] [v2:127.0.0.1:6828/3583639224,v1:127.0.0.1:6829/3583639224] exists,up bf942913-16e6-419a-9041-3cdd079b3c97 2026-02-17T08:30:48.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:30:48.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:30:48.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:30:48.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: objectstore_tool: wait_for_clean 2026-02-17T08:30:48.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:30:48.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:30:48.844 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:30:48.844 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:30:48.845 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:30:48.845 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:30:48.845 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:30:48.845 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:30:48.845 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:30:48.941 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:30:48.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:30:48.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:30:48.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:30:48.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:30:48.942 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:30:49.145 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:30:49.145 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:30:49.145 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:30:49.145 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:30:49.145 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:30:49.145 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:30:49.145 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:30:49.222 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803789 2026-02-17T08:30:49.222 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803789 2026-02-17T08:30:49.222 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803789' 2026-02-17T08:30:49.222 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:30:49.222 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:30:49.295 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=51539607563 2026-02-17T08:30:49.295 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 51539607563 2026-02-17T08:30:49.296 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803789 1-51539607563' 2026-02-17T08:30:49.296 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:30:49.296 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:30:49.370 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411337 2026-02-17T08:30:49.370 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411337 2026-02-17T08:30:49.370 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803789 1-51539607563 2-77309411337' 2026-02-17T08:30:49.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:30:49.371 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:30:49.446 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=163208757251 2026-02-17T08:30:49.446 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 163208757251 2026-02-17T08:30:49.446 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803789 1-51539607563 2-77309411337 3-163208757251' 2026-02-17T08:30:49.446 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:30:49.447 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803789 2026-02-17T08:30:49.447 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:30:49.447 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:30:49.448 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803789 2026-02-17T08:30:49.448 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:30:49.450 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803789 2026-02-17T08:30:49.450 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803789' 2026-02-17T08:30:49.450 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.0 seq 25769803789 2026-02-17T08:30:49.450 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:30:49.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803787 -lt 25769803789 2026-02-17T08:30:49.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:30:50.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:30:50.651 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:30:50.848 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803790 -lt 25769803789 2026-02-17T08:30:50.848 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:30:50.849 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-51539607563 2026-02-17T08:30:50.849 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:30:50.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:30:50.851 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-51539607563 2026-02-17T08:30:50.851 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:30:50.853 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=51539607563 2026-02-17T08:30:50.853 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 51539607563' 2026-02-17T08:30:50.853 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.1 seq 51539607563 2026-02-17T08:30:50.853 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:30:51.054 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 51539607563 -lt 51539607563 2026-02-17T08:30:51.054 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:30:51.054 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-77309411337 2026-02-17T08:30:51.054 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:30:51.055 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:30:51.056 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-77309411337 2026-02-17T08:30:51.056 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:30:51.058 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411337 2026-02-17T08:30:51.058 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 77309411337' 2026-02-17T08:30:51.058 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.2 seq 77309411337 2026-02-17T08:30:51.058 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:30:51.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411337 -lt 77309411337 2026-02-17T08:30:51.253 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:30:51.253 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-163208757251 2026-02-17T08:30:51.253 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:30:51.255 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:30:51.255 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-163208757251 2026-02-17T08:30:51.256 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:30:51.257 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=163208757251 2026-02-17T08:30:51.257 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 163208757251' 2026-02-17T08:30:51.257 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.3 seq 163208757251 2026-02-17T08:30:51.257 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:30:51.456 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 163208757251 -lt 163208757251 2026-02-17T08:30:51.456 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:30:51.457 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:30:51.457 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:30:51.720 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:30:51.721 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:30:51.721 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:30:51.721 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:30:51.721 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:30:51.721 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:30:51.721 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:30:51.722 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:30:51.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:30:51.918 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:30:51.918 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:30:51.919 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:30:52.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:30:52.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:30:52.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:30:52.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:217: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-17T08:30:52.181 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:218: set_size: ceph osd unset noout 2026-02-17T08:30:52.441 INFO:tasks.workunit.client.0.trial059.stderr:noout is unset 2026-02-17T08:30:52.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:238: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-70936-0-10 2026-02-17T08:30:52.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:30:52.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:30:52.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-70936-0-10 2026-02-17T08:30:52.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-17T08:30:52.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-17T08:30:52.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-size-70936-0-10 td/test-erasure-eio/COPY 2026-02-17T08:30:52.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-17T08:30:52.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-17T08:30:52.481 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:241: rados_get_data_bad_size: expr 0 + 1 2026-02-17T08:30:52.485 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:241: rados_get_data_bad_size: shard_id=1 2026-02-17T08:30:52.485 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:242: rados_get_data_bad_size: set_size obj-size-70936-0-10 td/test-erasure-eio 1 10 set 2026-02-17T08:30:52.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:192: set_size: local objname=obj-size-70936-0-10 2026-02-17T08:30:52.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:193: set_size: shift 2026-02-17T08:30:52.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:194: set_size: local dir=td/test-erasure-eio 2026-02-17T08:30:52.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:195: set_size: shift 2026-02-17T08:30:52.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:196: set_size: local shard_id=1 2026-02-17T08:30:52.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:197: set_size: shift 2026-02-17T08:30:52.487 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:198: set_size: local bytes=10 2026-02-17T08:30:52.487 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:199: set_size: shift 2026-02-17T08:30:52.487 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:200: set_size: local mode=set 2026-02-17T08:30:52.487 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local poolname=pool-jerasure 2026-02-17T08:30:52.487 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: get_osds pool-jerasure obj-size-70936-0-10 2026-02-17T08:30:52.488 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:30:52.488 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj-size-70936-0-10 2026-02-17T08:30:52.488 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj-size-70936-0-10 2026-02-17T08:30:52.488 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:30:52.685 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:30:52.686 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:30:52.686 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:30:52.686 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 2 2026-02-17T08:30:52.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: initial_osds=('3' '1' '2') 2026-02-17T08:30:52.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: local -a initial_osds 2026-02-17T08:30:52.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local osd_id=1 2026-02-17T08:30:52.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: ceph osd set noout 2026-02-17T08:30:52.948 INFO:tasks.workunit.client.0.trial059.stderr:noout is set 2026-02-17T08:30:52.957 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: '[' set = add ']' 2026-02-17T08:30:52.958 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: '[' 10 = 0 ']' 2026-02-17T08:30:52.958 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: dd if=/dev/urandom bs=10 count=1 of=td/test-erasure-eio/CORRUPT 2026-02-17T08:30:52.960 INFO:tasks.workunit.client.0.trial059.stderr:1+0 records in 2026-02-17T08:30:52.960 INFO:tasks.workunit.client.0.trial059.stderr:1+0 records out 2026-02-17T08:30:52.960 INFO:tasks.workunit.client.0.trial059.stderr:10 bytes copied, 3.0426e-05 s, 329 kB/s 2026-02-17T08:30:52.960 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: objectstore_tool td/test-erasure-eio 1 obj-size-70936-0-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:30:52.960 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1297: objectstore_tool: local dir=td/test-erasure-eio 2026-02-17T08:30:52.960 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: objectstore_tool: shift 2026-02-17T08:30:52.960 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1299: objectstore_tool: local id=1 2026-02-17T08:30:52.960 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: objectstore_tool: shift 2026-02-17T08:30:52.960 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-size-70936-0-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:30:52.960 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-17T08:30:52.961 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2026-02-17T08:30:52.961 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=1 2026-02-17T08:30:52.961 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2026-02-17T08:30:52.961 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-17T08:30:52.961 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:30:52.961 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:30:52.961 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:30:52.961 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:30:52.961 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:30:54.270 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:30:54.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-size-70936-0-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:30:54.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-17T08:30:54.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T08:30:54.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=1 2026-02-17T08:30:54.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T08:30:54.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-17T08:30:54.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-size-70936-0-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:30:55.460 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-17T08:30:55.460 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-eio 2026-02-17T08:30:55.460 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:30:55.460 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=1 2026-02-17T08:30:55.461 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:30:55.461 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-17T08:30:55.461 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:30:55.461 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:30:55.461 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:30:55.461 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:30:55.461 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-17T08:30:55.461 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-17T08:30:55.461 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:30:55.461 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:30:55.461 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:30:55.461 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:30:55.461 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:30:55.462 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:30:55.462 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:30:55.462 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:30:55.462 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:30:55.464 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:30:55.464 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:30:55.464 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:30:55.464 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:30:55.464 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:30:55.464 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:30:55.464 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:30:55.465 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:30:55.465 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:30:55.465 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:30:55.465 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:30:55.465 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-17T08:30:55.465 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.1 2026-02-17T08:30:55.465 INFO:tasks.workunit.client.0.trial059.stderr:start osd.1 2026-02-17T08:30:55.465 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:30:55.465 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-17T08:30:55.465 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 1 = 1 ']' 2026-02-17T08:30:55.465 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:30:55.465 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:30:55.466 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:30:55.485 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:55.468+0000 7f94978948c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:55.486 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:55.468+0000 7f94978948c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:55.488 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:55.468+0000 7f94978948c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:30:55.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 1 2026-02-17T08:30:55.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:30:55.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:30:55.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:30:55.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:30:55.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:55.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:30:55.657 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:30:55.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:55.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:30:55.863 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:56.743 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:56.724+0000 7f94978948c0 -1 Falling back to public interface 2026-02-17T08:30:56.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:56.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:56.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:30:56.865 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:30:56.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:56.866 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:30:57.064 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:58.066 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:58.066 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:58.066 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:30:58.066 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:30:58.067 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:58.067 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:30:58.266 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:59.267 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:30:59.267 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:30:59.267 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:30:59.267 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:30:59.268 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:30:59.268 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:30:59.467 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:30:59.742 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:30:59.724+0000 7f94978948c0 -1 osd.1 43 log_to_monitors true 2026-02-17T08:31:00.469 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:31:00.469 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:00.469 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:31:00.469 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:31:00.470 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:00.470 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:31:00.661 INFO:tasks.workunit.client.0.trial059.stderr:osd.1 up in weight 1 up_from 49 up_thru 49 down_at 46 last_clean_interval [12,43) [v2:127.0.0.1:6810/175308833,v1:127.0.0.1:6811/175308833] [v2:127.0.0.1:6812/175308833,v1:127.0.0.1:6813/175308833] exists,up 3aa1ea6e-25cd-413e-9c15-7ab4f137ba65 2026-02-17T08:31:00.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:31:00.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:31:00.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:31:00.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: objectstore_tool: wait_for_clean 2026-02-17T08:31:00.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:31:00.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:31:00.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:31:00.663 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:31:00.663 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:31:00.664 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:31:00.664 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:31:00.664 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:31:00.664 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:31:00.761 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:31:00.761 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:31:00.761 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:31:00.761 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:31:00.761 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:31:00.761 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:31:00.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:31:00.968 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:31:00.968 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:31:00.969 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:31:00.969 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:31:00.969 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:00.969 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:31:01.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803794 2026-02-17T08:31:01.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803794 2026-02-17T08:31:01.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803794' 2026-02-17T08:31:01.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:01.043 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:31:01.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=210453397507 2026-02-17T08:31:01.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 210453397507 2026-02-17T08:31:01.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803794 1-210453397507' 2026-02-17T08:31:01.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:01.119 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:31:01.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411341 2026-02-17T08:31:01.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411341 2026-02-17T08:31:01.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803794 1-210453397507 2-77309411341' 2026-02-17T08:31:01.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:01.195 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:31:01.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=163208757255 2026-02-17T08:31:01.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 163208757255 2026-02-17T08:31:01.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803794 1-210453397507 2-77309411341 3-163208757255' 2026-02-17T08:31:01.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:01.272 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803794 2026-02-17T08:31:01.272 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:01.272 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:31:01.273 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803794 2026-02-17T08:31:01.273 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:01.275 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803794 2026-02-17T08:31:01.275 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803794' 2026-02-17T08:31:01.275 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.0 seq 25769803794 2026-02-17T08:31:01.275 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:31:01.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803792 -lt 25769803794 2026-02-17T08:31:01.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:31:02.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:31:02.480 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:31:02.677 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803794 -lt 25769803794 2026-02-17T08:31:02.677 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:02.677 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-210453397507 2026-02-17T08:31:02.678 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:02.679 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:31:02.680 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-210453397507 2026-02-17T08:31:02.680 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:02.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=210453397507 2026-02-17T08:31:02.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 210453397507' 2026-02-17T08:31:02.681 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.1 seq 210453397507 2026-02-17T08:31:02.682 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:31:02.874 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 210453397507 -lt 210453397507 2026-02-17T08:31:02.875 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:02.875 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-77309411341 2026-02-17T08:31:02.875 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:02.876 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:31:02.877 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-77309411341 2026-02-17T08:31:02.877 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:02.878 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411341 2026-02-17T08:31:02.879 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 77309411341' 2026-02-17T08:31:02.879 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.2 seq 77309411341 2026-02-17T08:31:02.879 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:31:03.085 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411341 -lt 77309411341 2026-02-17T08:31:03.085 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:03.086 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-163208757255 2026-02-17T08:31:03.086 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:03.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:31:03.088 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-163208757255 2026-02-17T08:31:03.088 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:03.089 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=163208757255 2026-02-17T08:31:03.090 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 163208757255' 2026-02-17T08:31:03.090 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.3 seq 163208757255 2026-02-17T08:31:03.090 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:31:03.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 163208757255 -lt 163208757255 2026-02-17T08:31:03.289 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:31:03.289 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:31:03.289 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:31:03.544 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:31:03.545 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:31:03.545 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:31:03.545 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:31:03.545 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:31:03.545 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:31:03.546 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:31:03.546 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:31:03.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:31:03.736 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:31:03.736 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:31:03.736 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:31:03.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:31:03.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:31:03.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:31:03.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:217: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-17T08:31:03.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:218: set_size: ceph osd unset noout 2026-02-17T08:31:04.259 INFO:tasks.workunit.client.0.trial059.stderr:noout is unset 2026-02-17T08:31:04.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:243: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-70936-0-10 fail 2026-02-17T08:31:04.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:31:04.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:31:04.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-70936-0-10 2026-02-17T08:31:04.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=fail 2026-02-17T08:31:04.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' fail = fail ']' 2026-02-17T08:31:04.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:114: rados_get: rados --pool pool-jerasure get obj-size-70936-0-10 td/test-erasure-eio/COPY 2026-02-17T08:31:04.295 INFO:tasks.workunit.client.0.trial059.stderr:error getting pool-jerasure/obj-size-70936-0-10: (5) Input/output error 2026-02-17T08:31:04.297 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:115: rados_get: return 2026-02-17T08:31:04.297 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:244: rados_get_data_bad_size: rm td/test-erasure-eio/ORIGINAL 2026-02-17T08:31:04.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:310: TEST_rados_get_bad_size_shard_0: rados_get_data_bad_size td/test-erasure-eio 0 0 2026-02-17T08:31:04.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:222: rados_get_data_bad_size: local dir=td/test-erasure-eio 2026-02-17T08:31:04.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:223: rados_get_data_bad_size: shift 2026-02-17T08:31:04.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:224: rados_get_data_bad_size: local shard_id=0 2026-02-17T08:31:04.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:225: rados_get_data_bad_size: shift 2026-02-17T08:31:04.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: rados_get_data_bad_size: local bytes=0 2026-02-17T08:31:04.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: rados_get_data_bad_size: shift 2026-02-17T08:31:04.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: rados_get_data_bad_size: local mode=set 2026-02-17T08:31:04.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:230: rados_get_data_bad_size: local poolname=pool-jerasure 2026-02-17T08:31:04.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:231: rados_get_data_bad_size: local objname=obj-size-70936-0-0 2026-02-17T08:31:04.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:232: rados_get_data_bad_size: rados_put td/test-erasure-eio pool-jerasure obj-size-70936-0-0 2026-02-17T08:31:04.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-17T08:31:04.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-17T08:31:04.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-size-70936-0-0 2026-02-17T08:31:04.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:31:04.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-17T08:31:04.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:31:04.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-17T08:31:04.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:31:04.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-17T08:31:04.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:31:04.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-17T08:31:04.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-size-70936-0-0 td/test-erasure-eio/ORIGINAL 2026-02-17T08:31:04.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:236: rados_get_data_bad_size: set_size obj-size-70936-0-0 td/test-erasure-eio 0 0 set 2026-02-17T08:31:04.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:192: set_size: local objname=obj-size-70936-0-0 2026-02-17T08:31:04.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:193: set_size: shift 2026-02-17T08:31:04.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:194: set_size: local dir=td/test-erasure-eio 2026-02-17T08:31:04.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:195: set_size: shift 2026-02-17T08:31:04.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:196: set_size: local shard_id=0 2026-02-17T08:31:04.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:197: set_size: shift 2026-02-17T08:31:04.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:198: set_size: local bytes=0 2026-02-17T08:31:04.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:199: set_size: shift 2026-02-17T08:31:04.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:200: set_size: local mode=set 2026-02-17T08:31:04.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local poolname=pool-jerasure 2026-02-17T08:31:04.325 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: get_osds pool-jerasure obj-size-70936-0-0 2026-02-17T08:31:04.325 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:31:04.325 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj-size-70936-0-0 2026-02-17T08:31:04.326 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj-size-70936-0-0 2026-02-17T08:31:04.326 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:31:04.522 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:31:04.523 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:31:04.523 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:31:04.523 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 2 2026-02-17T08:31:04.523 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: initial_osds=('3' '1' '2') 2026-02-17T08:31:04.523 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: local -a initial_osds 2026-02-17T08:31:04.523 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local osd_id=3 2026-02-17T08:31:04.523 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: ceph osd set noout 2026-02-17T08:31:04.818 INFO:tasks.workunit.client.0.trial059.stderr:noout is set 2026-02-17T08:31:04.829 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: '[' set = add ']' 2026-02-17T08:31:04.830 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: '[' 0 = 0 ']' 2026-02-17T08:31:04.830 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: touch td/test-erasure-eio/CORRUPT 2026-02-17T08:31:04.831 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: objectstore_tool td/test-erasure-eio 3 obj-size-70936-0-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:31:04.832 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1297: objectstore_tool: local dir=td/test-erasure-eio 2026-02-17T08:31:04.832 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: objectstore_tool: shift 2026-02-17T08:31:04.832 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1299: objectstore_tool: local id=3 2026-02-17T08:31:04.832 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: objectstore_tool: shift 2026-02-17T08:31:04.832 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 3 obj-size-70936-0-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:31:04.832 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-17T08:31:04.832 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2026-02-17T08:31:04.832 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=3 2026-02-17T08:31:04.832 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2026-02-17T08:31:04.832 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.3 2026-02-17T08:31:04.833 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:31:04.833 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:31:04.833 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:31:04.833 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:31:04.833 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:31:06.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:31:06.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 3 obj-size-70936-0-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:31:06.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-17T08:31:06.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T08:31:06.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=3 2026-02-17T08:31:06.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T08:31:06.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/3 2026-02-17T08:31:06.143 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/3 obj-size-70936-0-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:31:07.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 3 2026-02-17T08:31:07.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-eio 2026-02-17T08:31:07.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:31:07.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=3 2026-02-17T08:31:07.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:31:07.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-eio/3 2026-02-17T08:31:07.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:31:07.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:31:07.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:31:07.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:31:07.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-17T08:31:07.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-17T08:31:07.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:31:07.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:31:07.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:31:07.321 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:31:07.321 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:31:07.322 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:31:07.322 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:31:07.322 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:31:07.322 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:31:07.322 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:31:07.322 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:31:07.322 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:31:07.322 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:31:07.322 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:31:07.322 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:31:07.322 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:31:07.322 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:31:07.323 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:31:07.323 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:31:07.323 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:31:07.323 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-eio/3 2026-02-17T08:31:07.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.3 2026-02-17T08:31:07.324 INFO:tasks.workunit.client.0.trial059.stderr:start osd.3 2026-02-17T08:31:07.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:31:07.325 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-eio/3/whoami 2026-02-17T08:31:07.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 3 = 3 ']' 2026-02-17T08:31:07.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:31:07.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:31:07.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:31:07.340 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:31:07.320+0000 7f7375ba58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:31:07.341 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:31:07.320+0000 7f7375ba58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:31:07.342 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:31:07.324+0000 7f7375ba58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:31:07.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 3 2026-02-17T08:31:07.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:31:07.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T08:31:07.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:31:07.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:31:07.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:07.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:31:07.516 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:31:07.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:07.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:31:07.715 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:31:08.587 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:31:08.568+0000 7f7375ba58c0 -1 Falling back to public interface 2026-02-17T08:31:08.717 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:31:08.717 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:08.717 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:31:08.717 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:31:08.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:08.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:31:08.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:31:09.920 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:31:09.921 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:09.921 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:31:09.921 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:31:09.921 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:09.921 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:31:10.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:31:11.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:31:11.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:11.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:31:11.122 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:31:11.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:11.123 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:31:11.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:31:11.623 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:31:11.604+0000 7f7375ba58c0 -1 osd.3 54 log_to_monitors true 2026-02-17T08:31:12.323 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:31:12.323 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:12.323 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:31:12.323 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:31:12.323 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:12.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:31:12.518 INFO:tasks.workunit.client.0.trial059.stderr:osd.3 up in weight 1 up_from 58 up_thru 58 down_at 55 last_clean_interval [38,54) [v2:127.0.0.1:6826/4023344276,v1:127.0.0.1:6827/4023344276] [v2:127.0.0.1:6828/4023344276,v1:127.0.0.1:6829/4023344276] exists,up bf942913-16e6-419a-9041-3cdd079b3c97 2026-02-17T08:31:12.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:31:12.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:31:12.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:31:12.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: objectstore_tool: wait_for_clean 2026-02-17T08:31:12.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:31:12.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:31:12.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:31:12.519 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:31:12.520 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:31:12.520 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:31:12.520 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:31:12.521 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:31:12.521 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:31:12.627 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:31:12.628 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:31:12.628 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:31:12.628 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:31:12.628 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:31:12.628 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:31:12.831 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:31:12.831 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:31:12.831 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:31:12.831 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:31:12.832 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:31:12.832 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:12.832 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:31:12.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803798 2026-02-17T08:31:12.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803798 2026-02-17T08:31:12.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803798' 2026-02-17T08:31:12.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:12.908 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:31:12.984 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=210453397511 2026-02-17T08:31:12.984 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 210453397511 2026-02-17T08:31:12.984 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803798 1-210453397511' 2026-02-17T08:31:12.984 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:12.985 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:31:13.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411346 2026-02-17T08:31:13.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411346 2026-02-17T08:31:13.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803798 1-210453397511 2-77309411346' 2026-02-17T08:31:13.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:13.063 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:31:13.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=249108103171 2026-02-17T08:31:13.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 249108103171 2026-02-17T08:31:13.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803798 1-210453397511 2-77309411346 3-249108103171' 2026-02-17T08:31:13.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:13.137 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803798 2026-02-17T08:31:13.137 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:13.138 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:31:13.139 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803798 2026-02-17T08:31:13.139 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:13.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803798 2026-02-17T08:31:13.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803798' 2026-02-17T08:31:13.140 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.0 seq 25769803798 2026-02-17T08:31:13.141 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:31:13.346 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803796 -lt 25769803798 2026-02-17T08:31:13.346 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:31:14.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:31:14.348 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:31:14.548 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803798 -lt 25769803798 2026-02-17T08:31:14.548 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:14.549 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-210453397511 2026-02-17T08:31:14.549 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:14.549 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:31:14.550 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-210453397511 2026-02-17T08:31:14.551 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:14.552 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=210453397511 2026-02-17T08:31:14.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 210453397511' 2026-02-17T08:31:14.553 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.1 seq 210453397511 2026-02-17T08:31:14.553 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:31:14.757 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 210453397511 -lt 210453397511 2026-02-17T08:31:14.757 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:14.757 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-77309411346 2026-02-17T08:31:14.758 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:14.758 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:31:14.759 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-77309411346 2026-02-17T08:31:14.759 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:14.761 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411346 2026-02-17T08:31:14.761 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 77309411346' 2026-02-17T08:31:14.761 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.2 seq 77309411346 2026-02-17T08:31:14.761 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:31:14.970 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411346 -lt 77309411346 2026-02-17T08:31:14.971 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:14.971 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-249108103171 2026-02-17T08:31:14.972 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:14.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:31:14.973 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-249108103171 2026-02-17T08:31:14.973 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:14.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=249108103171 2026-02-17T08:31:14.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 249108103171' 2026-02-17T08:31:14.975 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.3 seq 249108103171 2026-02-17T08:31:14.975 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:31:15.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 249108103171 -lt 249108103171 2026-02-17T08:31:15.181 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:31:15.181 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:31:15.181 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:31:15.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:31:15.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:31:15.435 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:31:15.435 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:31:15.435 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:31:15.435 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:31:15.435 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:31:15.435 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:31:15.624 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:31:15.625 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:31:15.626 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:31:15.626 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:31:15.880 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:31:15.880 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:31:15.880 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:31:15.880 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:217: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-17T08:31:15.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:218: set_size: ceph osd unset noout 2026-02-17T08:31:16.150 INFO:tasks.workunit.client.0.trial059.stderr:noout is unset 2026-02-17T08:31:16.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:238: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-70936-0-0 2026-02-17T08:31:16.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:31:16.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:31:16.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-70936-0-0 2026-02-17T08:31:16.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-17T08:31:16.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-17T08:31:16.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-size-70936-0-0 td/test-erasure-eio/COPY 2026-02-17T08:31:16.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-17T08:31:16.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-17T08:31:16.188 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:241: rados_get_data_bad_size: expr 0 + 1 2026-02-17T08:31:16.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:241: rados_get_data_bad_size: shard_id=1 2026-02-17T08:31:16.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:242: rados_get_data_bad_size: set_size obj-size-70936-0-0 td/test-erasure-eio 1 0 set 2026-02-17T08:31:16.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:192: set_size: local objname=obj-size-70936-0-0 2026-02-17T08:31:16.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:193: set_size: shift 2026-02-17T08:31:16.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:194: set_size: local dir=td/test-erasure-eio 2026-02-17T08:31:16.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:195: set_size: shift 2026-02-17T08:31:16.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:196: set_size: local shard_id=1 2026-02-17T08:31:16.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:197: set_size: shift 2026-02-17T08:31:16.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:198: set_size: local bytes=0 2026-02-17T08:31:16.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:199: set_size: shift 2026-02-17T08:31:16.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:200: set_size: local mode=set 2026-02-17T08:31:16.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local poolname=pool-jerasure 2026-02-17T08:31:16.190 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: get_osds pool-jerasure obj-size-70936-0-0 2026-02-17T08:31:16.190 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:31:16.190 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj-size-70936-0-0 2026-02-17T08:31:16.191 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj-size-70936-0-0 2026-02-17T08:31:16.191 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:31:16.385 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:31:16.385 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:31:16.385 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:31:16.386 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 2 2026-02-17T08:31:16.386 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: initial_osds=('3' '1' '2') 2026-02-17T08:31:16.386 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: local -a initial_osds 2026-02-17T08:31:16.386 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local osd_id=1 2026-02-17T08:31:16.386 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: ceph osd set noout 2026-02-17T08:31:16.655 INFO:tasks.workunit.client.0.trial059.stderr:noout is set 2026-02-17T08:31:16.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: '[' set = add ']' 2026-02-17T08:31:16.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: '[' 0 = 0 ']' 2026-02-17T08:31:16.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: touch td/test-erasure-eio/CORRUPT 2026-02-17T08:31:16.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: objectstore_tool td/test-erasure-eio 1 obj-size-70936-0-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:31:16.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1297: objectstore_tool: local dir=td/test-erasure-eio 2026-02-17T08:31:16.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: objectstore_tool: shift 2026-02-17T08:31:16.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1299: objectstore_tool: local id=1 2026-02-17T08:31:16.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: objectstore_tool: shift 2026-02-17T08:31:16.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-size-70936-0-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:31:16.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-17T08:31:16.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2026-02-17T08:31:16.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=1 2026-02-17T08:31:16.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2026-02-17T08:31:16.668 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-17T08:31:16.668 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:31:16.668 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:31:16.669 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:31:16.669 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:31:16.669 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:31:17.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:31:17.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-size-70936-0-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:31:17.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-17T08:31:17.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T08:31:17.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=1 2026-02-17T08:31:17.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T08:31:17.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-17T08:31:17.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-size-70936-0-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:31:19.152 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-17T08:31:19.153 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-eio 2026-02-17T08:31:19.153 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:31:19.153 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=1 2026-02-17T08:31:19.153 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:31:19.153 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-17T08:31:19.153 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:31:19.153 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:31:19.153 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:31:19.154 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:31:19.154 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-17T08:31:19.154 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-17T08:31:19.154 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:31:19.154 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:31:19.154 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:31:19.154 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:31:19.154 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:31:19.154 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:31:19.154 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:31:19.154 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:31:19.154 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:31:19.155 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:31:19.157 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:31:19.157 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:31:19.157 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:31:19.157 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:31:19.157 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:31:19.157 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:31:19.157 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:31:19.157 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:31:19.157 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:31:19.158 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:31:19.158 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-17T08:31:19.158 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.1 2026-02-17T08:31:19.158 INFO:tasks.workunit.client.0.trial059.stderr:start osd.1 2026-02-17T08:31:19.158 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:31:19.158 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-17T08:31:19.158 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 1 = 1 ']' 2026-02-17T08:31:19.158 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:31:19.158 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:31:19.158 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:31:19.173 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:31:19.152+0000 7ff3cde618c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:31:19.174 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:31:19.156+0000 7ff3cde618c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:31:19.175 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:31:19.156+0000 7ff3cde618c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:31:19.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 1 2026-02-17T08:31:19.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:31:19.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:31:19.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:31:19.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:31:19.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:19.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:31:19.355 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:31:19.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:19.355 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:31:19.552 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:31:20.403 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:31:20.384+0000 7ff3cde618c0 -1 Falling back to public interface 2026-02-17T08:31:20.554 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:31:20.554 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:20.554 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:31:20.554 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:31:20.554 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:20.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:31:20.747 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:31:21.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:31:21.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:21.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:31:21.749 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:31:21.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:21.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:31:21.945 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:31:22.947 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:31:22.947 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:22.947 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:31:22.947 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:31:22.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:22.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:31:23.139 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:31:23.483 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:31:23.464+0000 7ff3cde618c0 -1 osd.1 62 log_to_monitors true 2026-02-17T08:31:24.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:31:24.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:24.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:31:24.141 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:31:24.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:24.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:31:24.334 INFO:tasks.workunit.client.0.trial059.stderr:osd.1 up in weight 1 up_from 68 up_thru 68 down_at 65 last_clean_interval [49,62) [v2:127.0.0.1:6810/437819855,v1:127.0.0.1:6811/437819855] [v2:127.0.0.1:6812/437819855,v1:127.0.0.1:6813/437819855] exists,up 3aa1ea6e-25cd-413e-9c15-7ab4f137ba65 2026-02-17T08:31:24.335 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:31:24.335 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:31:24.335 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:31:24.335 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: objectstore_tool: wait_for_clean 2026-02-17T08:31:24.335 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:31:24.335 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:31:24.335 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:31:24.335 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:31:24.335 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:31:24.336 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:31:24.336 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:31:24.336 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:31:24.336 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:31:24.436 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:31:24.437 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:31:24.437 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:31:24.437 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:31:24.437 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:31:24.437 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:31:24.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:31:24.633 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:31:24.633 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:31:24.633 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:31:24.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:31:24.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:24.633 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:31:24.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803802 2026-02-17T08:31:24.708 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803802 2026-02-17T08:31:24.708 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803802' 2026-02-17T08:31:24.708 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:24.708 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:31:24.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=292057776131 2026-02-17T08:31:24.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 292057776131 2026-02-17T08:31:24.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803802 1-292057776131' 2026-02-17T08:31:24.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:24.783 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:31:24.859 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411350 2026-02-17T08:31:24.859 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411350 2026-02-17T08:31:24.859 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803802 1-292057776131 2-77309411350' 2026-02-17T08:31:24.859 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:24.859 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:31:24.933 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=249108103175 2026-02-17T08:31:24.933 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 249108103175 2026-02-17T08:31:24.933 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803802 1-292057776131 2-77309411350 3-249108103175' 2026-02-17T08:31:24.934 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:24.934 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803802 2026-02-17T08:31:24.934 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:24.935 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:31:24.935 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803802 2026-02-17T08:31:24.936 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:24.937 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803802 2026-02-17T08:31:24.937 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803802' 2026-02-17T08:31:24.937 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.0 seq 25769803802 2026-02-17T08:31:24.938 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:31:25.134 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803800 -lt 25769803802 2026-02-17T08:31:25.134 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:31:26.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:31:26.137 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:31:26.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803803 -lt 25769803802 2026-02-17T08:31:26.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:26.335 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-292057776131 2026-02-17T08:31:26.335 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:26.336 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:31:26.337 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-292057776131 2026-02-17T08:31:26.337 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:26.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=292057776131 2026-02-17T08:31:26.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 292057776131' 2026-02-17T08:31:26.339 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.1 seq 292057776131 2026-02-17T08:31:26.339 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:31:26.547 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 292057776131 -lt 292057776131 2026-02-17T08:31:26.548 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:26.548 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-77309411350 2026-02-17T08:31:26.548 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:26.550 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:31:26.550 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-77309411350 2026-02-17T08:31:26.551 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:26.552 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411350 2026-02-17T08:31:26.552 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 77309411350' 2026-02-17T08:31:26.552 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.2 seq 77309411350 2026-02-17T08:31:26.552 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:31:26.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411350 -lt 77309411350 2026-02-17T08:31:26.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:26.756 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-249108103175 2026-02-17T08:31:26.756 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:26.757 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:31:26.758 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-249108103175 2026-02-17T08:31:26.758 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:26.760 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=249108103175 2026-02-17T08:31:26.760 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 249108103175' 2026-02-17T08:31:26.760 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.3 seq 249108103175 2026-02-17T08:31:26.761 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:31:26.970 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 249108103175 -lt 249108103175 2026-02-17T08:31:26.970 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:31:26.971 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:31:26.971 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:31:27.258 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:31:27.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:31:27.259 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:31:27.259 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:31:27.259 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:31:27.259 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:31:27.260 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:31:27.260 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:31:27.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:31:27.453 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:31:27.454 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:31:27.454 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:31:27.716 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:31:27.717 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:31:27.717 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:31:27.717 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:217: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-17T08:31:27.717 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:218: set_size: ceph osd unset noout 2026-02-17T08:31:27.980 INFO:tasks.workunit.client.0.trial059.stderr:noout is unset 2026-02-17T08:31:27.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:243: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-70936-0-0 fail 2026-02-17T08:31:27.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:31:27.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:31:27.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-70936-0-0 2026-02-17T08:31:27.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=fail 2026-02-17T08:31:27.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' fail = fail ']' 2026-02-17T08:31:27.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:114: rados_get: rados --pool pool-jerasure get obj-size-70936-0-0 td/test-erasure-eio/COPY 2026-02-17T08:31:28.014 INFO:tasks.workunit.client.0.trial059.stderr:error getting pool-jerasure/obj-size-70936-0-0: (5) Input/output error 2026-02-17T08:31:28.016 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:115: rados_get: return 2026-02-17T08:31:28.016 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:244: rados_get_data_bad_size: rm td/test-erasure-eio/ORIGINAL 2026-02-17T08:31:28.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:311: TEST_rados_get_bad_size_shard_0: rados_get_data_bad_size td/test-erasure-eio 0 256 add 2026-02-17T08:31:28.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:222: rados_get_data_bad_size: local dir=td/test-erasure-eio 2026-02-17T08:31:28.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:223: rados_get_data_bad_size: shift 2026-02-17T08:31:28.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:224: rados_get_data_bad_size: local shard_id=0 2026-02-17T08:31:28.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:225: rados_get_data_bad_size: shift 2026-02-17T08:31:28.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: rados_get_data_bad_size: local bytes=256 2026-02-17T08:31:28.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: rados_get_data_bad_size: shift 2026-02-17T08:31:28.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: rados_get_data_bad_size: local mode=add 2026-02-17T08:31:28.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:230: rados_get_data_bad_size: local poolname=pool-jerasure 2026-02-17T08:31:28.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:231: rados_get_data_bad_size: local objname=obj-size-70936-0-256 2026-02-17T08:31:28.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:232: rados_get_data_bad_size: rados_put td/test-erasure-eio pool-jerasure obj-size-70936-0-256 2026-02-17T08:31:28.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-17T08:31:28.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-17T08:31:28.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-size-70936-0-256 2026-02-17T08:31:28.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:31:28.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-17T08:31:28.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:31:28.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-17T08:31:28.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:31:28.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-17T08:31:28.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:31:28.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-17T08:31:28.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-size-70936-0-256 td/test-erasure-eio/ORIGINAL 2026-02-17T08:31:28.037 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:236: rados_get_data_bad_size: set_size obj-size-70936-0-256 td/test-erasure-eio 0 256 add 2026-02-17T08:31:28.037 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:192: set_size: local objname=obj-size-70936-0-256 2026-02-17T08:31:28.037 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:193: set_size: shift 2026-02-17T08:31:28.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:194: set_size: local dir=td/test-erasure-eio 2026-02-17T08:31:28.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:195: set_size: shift 2026-02-17T08:31:28.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:196: set_size: local shard_id=0 2026-02-17T08:31:28.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:197: set_size: shift 2026-02-17T08:31:28.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:198: set_size: local bytes=256 2026-02-17T08:31:28.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:199: set_size: shift 2026-02-17T08:31:28.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:200: set_size: local mode=add 2026-02-17T08:31:28.038 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local poolname=pool-jerasure 2026-02-17T08:31:28.038 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: get_osds pool-jerasure obj-size-70936-0-256 2026-02-17T08:31:28.038 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:31:28.038 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj-size-70936-0-256 2026-02-17T08:31:28.039 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj-size-70936-0-256 2026-02-17T08:31:28.039 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:31:28.236 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:31:28.236 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:31:28.236 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:31:28.236 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 2 2026-02-17T08:31:28.236 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: initial_osds=('3' '1' '2') 2026-02-17T08:31:28.236 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: local -a initial_osds 2026-02-17T08:31:28.236 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local osd_id=3 2026-02-17T08:31:28.236 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: ceph osd set noout 2026-02-17T08:31:28.486 INFO:tasks.workunit.client.0.trial059.stderr:noout is set 2026-02-17T08:31:28.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: '[' add = add ']' 2026-02-17T08:31:28.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: objectstore_tool td/test-erasure-eio 3 obj-size-70936-0-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:31:28.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1297: objectstore_tool: local dir=td/test-erasure-eio 2026-02-17T08:31:28.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: objectstore_tool: shift 2026-02-17T08:31:28.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1299: objectstore_tool: local id=3 2026-02-17T08:31:28.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: objectstore_tool: shift 2026-02-17T08:31:28.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 3 obj-size-70936-0-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:31:28.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-17T08:31:28.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2026-02-17T08:31:28.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=3 2026-02-17T08:31:28.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2026-02-17T08:31:28.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.3 2026-02-17T08:31:28.497 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:31:28.497 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:31:28.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:31:28.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:31:28.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:31:29.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:31:29.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 3 obj-size-70936-0-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:31:29.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-17T08:31:29.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T08:31:29.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=3 2026-02-17T08:31:29.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T08:31:29.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/3 2026-02-17T08:31:29.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/3 obj-size-70936-0-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:31:30.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 3 2026-02-17T08:31:30.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-eio 2026-02-17T08:31:30.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:31:30.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=3 2026-02-17T08:31:30.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:31:30.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-eio/3 2026-02-17T08:31:30.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:31:30.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:31:30.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:31:30.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:31:30.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-17T08:31:30.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-17T08:31:30.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:31:30.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:31:30.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:31:30.657 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:31:30.657 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:31:30.657 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:31:30.657 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:31:30.658 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:31:30.658 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:31:30.660 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:31:30.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:31:30.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:31:30.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:31:30.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:31:30.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:31:30.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:31:30.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:31:30.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:31:30.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:31:30.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:31:30.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-eio/3 2026-02-17T08:31:30.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.3 2026-02-17T08:31:30.661 INFO:tasks.workunit.client.0.trial059.stderr:start osd.3 2026-02-17T08:31:30.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:31:30.661 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-eio/3/whoami 2026-02-17T08:31:30.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 3 = 3 ']' 2026-02-17T08:31:30.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:31:30.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:31:30.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:31:30.676 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:31:30.656+0000 7f3c44baf8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:31:30.677 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:31:30.660+0000 7f3c44baf8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:31:30.678 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:31:30.660+0000 7f3c44baf8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:31:30.854 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 3 2026-02-17T08:31:30.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:31:30.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T08:31:30.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:31:30.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:31:30.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:30.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:31:30.855 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:31:30.855 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:30.856 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:31:31.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:31:31.923 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:31:31.904+0000 7f3c44baf8c0 -1 Falling back to public interface 2026-02-17T08:31:32.053 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:31:32.053 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:32.053 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:31:32.053 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:31:32.053 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:32.053 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:31:32.251 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:31:33.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:31:33.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:33.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:31:33.252 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:31:33.253 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:33.253 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:31:33.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:31:34.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:31:34.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:34.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:31:34.453 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:31:34.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:34.453 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:31:34.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:31:34.983 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:31:34.964+0000 7f3c44baf8c0 -1 osd.3 71 log_to_monitors true 2026-02-17T08:31:35.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:31:35.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:35.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:31:35.650 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:31:35.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:35.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:31:35.842 INFO:tasks.workunit.client.0.trial059.stderr:osd.3 up in weight 1 up_from 77 up_thru 77 down_at 74 last_clean_interval [58,71) [v2:127.0.0.1:6826/1841714602,v1:127.0.0.1:6827/1841714602] [v2:127.0.0.1:6828/1841714602,v1:127.0.0.1:6829/1841714602] exists,up bf942913-16e6-419a-9041-3cdd079b3c97 2026-02-17T08:31:35.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:31:35.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:31:35.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:31:35.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: objectstore_tool: wait_for_clean 2026-02-17T08:31:35.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:31:35.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:31:35.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:31:35.843 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:31:35.844 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:31:35.844 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:31:35.845 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:31:35.845 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:31:35.845 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:31:35.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:31:35.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:31:35.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:31:35.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:31:35.954 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:31:35.954 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:31:36.156 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:31:36.156 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:31:36.156 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:31:36.156 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:31:36.156 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:31:36.156 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:36.156 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:31:36.234 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803807 2026-02-17T08:31:36.234 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803807 2026-02-17T08:31:36.234 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803807' 2026-02-17T08:31:36.234 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:36.234 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:31:36.307 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=292057776135 2026-02-17T08:31:36.308 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 292057776135 2026-02-17T08:31:36.308 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803807 1-292057776135' 2026-02-17T08:31:36.308 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:36.308 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:31:36.384 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411354 2026-02-17T08:31:36.384 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411354 2026-02-17T08:31:36.384 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803807 1-292057776135 2-77309411354' 2026-02-17T08:31:36.384 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:36.384 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:31:36.457 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=330712481795 2026-02-17T08:31:36.457 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 330712481795 2026-02-17T08:31:36.458 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803807 1-292057776135 2-77309411354 3-330712481795' 2026-02-17T08:31:36.458 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:36.458 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803807 2026-02-17T08:31:36.458 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:36.459 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:31:36.460 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803807 2026-02-17T08:31:36.460 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:36.462 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803807 2026-02-17T08:31:36.462 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803807' 2026-02-17T08:31:36.462 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.0 seq 25769803807 2026-02-17T08:31:36.462 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:31:36.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803805 -lt 25769803807 2026-02-17T08:31:36.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:31:37.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:31:37.665 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:31:37.863 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803805 -lt 25769803807 2026-02-17T08:31:37.863 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:31:38.864 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T08:31:38.865 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:31:39.066 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803807 -lt 25769803807 2026-02-17T08:31:39.066 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:39.067 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-292057776135 2026-02-17T08:31:39.067 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:39.068 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:31:39.069 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-292057776135 2026-02-17T08:31:39.069 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:39.070 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=292057776135 2026-02-17T08:31:39.070 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 292057776135' 2026-02-17T08:31:39.071 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.1 seq 292057776135 2026-02-17T08:31:39.071 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:31:39.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 292057776135 -lt 292057776135 2026-02-17T08:31:39.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:39.280 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-77309411354 2026-02-17T08:31:39.281 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:39.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:31:39.282 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-77309411354 2026-02-17T08:31:39.283 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:39.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411354 2026-02-17T08:31:39.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 77309411354' 2026-02-17T08:31:39.284 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.2 seq 77309411354 2026-02-17T08:31:39.285 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:31:39.483 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411355 -lt 77309411354 2026-02-17T08:31:39.483 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:39.483 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-330712481795 2026-02-17T08:31:39.484 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:39.485 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:31:39.485 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-330712481795 2026-02-17T08:31:39.486 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:39.487 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=330712481795 2026-02-17T08:31:39.487 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 330712481795' 2026-02-17T08:31:39.487 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.3 seq 330712481795 2026-02-17T08:31:39.488 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:31:39.692 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 330712481795 -lt 330712481795 2026-02-17T08:31:39.693 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:31:39.694 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:31:39.694 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:31:39.947 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:31:39.947 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:31:39.947 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:31:39.947 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:31:39.947 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:31:39.947 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:31:39.948 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:31:39.948 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:31:40.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:31:40.140 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:31:40.141 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:31:40.141 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:31:40.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:31:40.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:31:40.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:31:40.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: dd if=/dev/urandom bs=256 count=1 2026-02-17T08:31:40.398 INFO:tasks.workunit.client.0.trial059.stderr:1+0 records in 2026-02-17T08:31:40.398 INFO:tasks.workunit.client.0.trial059.stderr:1+0 records out 2026-02-17T08:31:40.398 INFO:tasks.workunit.client.0.trial059.stderr:256 bytes copied, 2.2563e-05 s, 11.3 MB/s 2026-02-17T08:31:40.398 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: objectstore_tool td/test-erasure-eio 3 obj-size-70936-0-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:31:40.398 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1297: objectstore_tool: local dir=td/test-erasure-eio 2026-02-17T08:31:40.398 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: objectstore_tool: shift 2026-02-17T08:31:40.398 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1299: objectstore_tool: local id=3 2026-02-17T08:31:40.398 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: objectstore_tool: shift 2026-02-17T08:31:40.398 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 3 obj-size-70936-0-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:31:40.398 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-17T08:31:40.398 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2026-02-17T08:31:40.399 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=3 2026-02-17T08:31:40.399 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2026-02-17T08:31:40.399 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.3 2026-02-17T08:31:40.399 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:31:40.399 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:31:40.399 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:31:40.399 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:31:40.399 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:31:41.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:31:41.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 3 obj-size-70936-0-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:31:41.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-17T08:31:41.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T08:31:41.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=3 2026-02-17T08:31:41.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T08:31:41.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/3 2026-02-17T08:31:41.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/3 obj-size-70936-0-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:31:42.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 3 2026-02-17T08:31:42.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-eio 2026-02-17T08:31:42.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:31:42.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=3 2026-02-17T08:31:42.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:31:42.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-eio/3 2026-02-17T08:31:42.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:31:42.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:31:42.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:31:42.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:31:42.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-17T08:31:42.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-17T08:31:42.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:31:42.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:31:42.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:31:42.884 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:31:42.884 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:31:42.884 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:31:42.884 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:31:42.884 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:31:42.884 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:31:42.884 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:31:42.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:31:42.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:31:42.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:31:42.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:31:42.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:31:42.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:31:42.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:31:42.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:31:42.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:31:42.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:31:42.885 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-eio/3 2026-02-17T08:31:42.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.3 2026-02-17T08:31:42.886 INFO:tasks.workunit.client.0.trial059.stderr:start osd.3 2026-02-17T08:31:42.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:31:42.887 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-eio/3/whoami 2026-02-17T08:31:42.888 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 3 = 3 ']' 2026-02-17T08:31:42.888 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:31:42.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:31:42.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:31:42.909 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:31:42.892+0000 7f8a40eb48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:31:42.910 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:31:42.892+0000 7f8a40eb48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:31:42.911 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:31:42.892+0000 7f8a40eb48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:31:43.086 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 3 2026-02-17T08:31:43.086 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:31:43.086 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T08:31:43.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:31:43.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:31:43.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:43.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:31:43.087 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:31:43.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:43.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:31:43.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:31:44.207 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:31:44.188+0000 7f8a40eb48c0 -1 Falling back to public interface 2026-02-17T08:31:44.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:31:44.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:44.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:31:44.289 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:31:44.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:44.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:31:44.491 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:31:45.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:31:45.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:45.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:31:45.494 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:31:45.494 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:45.494 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:31:45.691 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:31:46.692 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:31:46.693 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:46.693 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:31:46.693 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:31:46.693 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:46.693 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:31:46.891 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:31:47.490 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:31:47.472+0000 7f8a40eb48c0 -1 osd.3 79 log_to_monitors true 2026-02-17T08:31:47.892 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:31:47.892 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:47.893 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:31:47.893 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:31:47.893 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:47.893 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:31:48.094 INFO:tasks.workunit.client.0.trial059.stderr:osd.3 up in weight 1 up_from 83 up_thru 83 down_at 80 last_clean_interval [77,79) [v2:127.0.0.1:6826/1463559416,v1:127.0.0.1:6827/1463559416] [v2:127.0.0.1:6828/1463559416,v1:127.0.0.1:6829/1463559416] exists,up bf942913-16e6-419a-9041-3cdd079b3c97 2026-02-17T08:31:48.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:31:48.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:31:48.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:31:48.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: objectstore_tool: wait_for_clean 2026-02-17T08:31:48.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:31:48.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:31:48.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:31:48.095 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:31:48.096 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:31:48.096 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:31:48.096 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:31:48.096 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:31:48.097 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:31:48.208 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:31:48.208 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:31:48.208 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:31:48.209 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:31:48.209 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:31:48.209 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:31:48.404 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:31:48.404 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:31:48.404 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:31:48.404 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:31:48.405 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:31:48.405 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:48.405 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:31:48.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803811 2026-02-17T08:31:48.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803811 2026-02-17T08:31:48.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803811' 2026-02-17T08:31:48.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:48.481 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:31:48.556 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=292057776139 2026-02-17T08:31:48.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 292057776139 2026-02-17T08:31:48.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803811 1-292057776139' 2026-02-17T08:31:48.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:48.557 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:31:48.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411359 2026-02-17T08:31:48.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411359 2026-02-17T08:31:48.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803811 1-292057776139 2-77309411359' 2026-02-17T08:31:48.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:31:48.633 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:31:48.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=356482285571 2026-02-17T08:31:48.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 356482285571 2026-02-17T08:31:48.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803811 1-292057776139 2-77309411359 3-356482285571' 2026-02-17T08:31:48.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:48.707 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803811 2026-02-17T08:31:48.707 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:48.708 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:31:48.709 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803811 2026-02-17T08:31:48.709 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:48.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803811 2026-02-17T08:31:48.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803811' 2026-02-17T08:31:48.711 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.0 seq 25769803811 2026-02-17T08:31:48.711 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:31:48.922 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803809 -lt 25769803811 2026-02-17T08:31:48.922 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:31:49.924 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:31:49.924 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:31:50.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803809 -lt 25769803811 2026-02-17T08:31:50.120 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:31:51.121 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T08:31:51.122 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:31:51.322 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803812 -lt 25769803811 2026-02-17T08:31:51.322 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:51.323 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-292057776139 2026-02-17T08:31:51.323 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:51.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:31:51.325 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-292057776139 2026-02-17T08:31:51.325 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:51.327 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=292057776139 2026-02-17T08:31:51.327 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 292057776139' 2026-02-17T08:31:51.327 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.1 seq 292057776139 2026-02-17T08:31:51.327 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:31:51.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 292057776140 -lt 292057776139 2026-02-17T08:31:51.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:51.532 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-77309411359 2026-02-17T08:31:51.532 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:51.533 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:31:51.535 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-77309411359 2026-02-17T08:31:51.535 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:51.536 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411359 2026-02-17T08:31:51.536 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 77309411359' 2026-02-17T08:31:51.536 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.2 seq 77309411359 2026-02-17T08:31:51.537 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:31:51.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411359 -lt 77309411359 2026-02-17T08:31:51.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:31:51.745 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-356482285571 2026-02-17T08:31:51.745 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:31:51.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:31:51.746 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-356482285571 2026-02-17T08:31:51.747 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:31:51.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=356482285571 2026-02-17T08:31:51.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 356482285571' 2026-02-17T08:31:51.748 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.3 seq 356482285571 2026-02-17T08:31:51.749 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:31:51.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 356482285571 -lt 356482285571 2026-02-17T08:31:51.944 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:31:51.945 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:31:51.945 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:31:52.200 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:31:52.200 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:31:52.200 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:31:52.200 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:31:52.201 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:31:52.201 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:31:52.201 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:31:52.201 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:31:52.391 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:31:52.391 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:31:52.392 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:31:52.392 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:31:52.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:31:52.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:31:52.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:31:52.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:217: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-17T08:31:52.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:218: set_size: ceph osd unset noout 2026-02-17T08:31:52.914 INFO:tasks.workunit.client.0.trial059.stderr:noout is unset 2026-02-17T08:31:52.925 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:238: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-70936-0-256 2026-02-17T08:31:52.925 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:31:52.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:31:52.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-70936-0-256 2026-02-17T08:31:52.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-17T08:31:52.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-17T08:31:52.926 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-size-70936-0-256 td/test-erasure-eio/COPY 2026-02-17T08:31:52.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-17T08:31:52.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-17T08:31:52.953 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:241: rados_get_data_bad_size: expr 0 + 1 2026-02-17T08:31:52.955 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:241: rados_get_data_bad_size: shard_id=1 2026-02-17T08:31:52.955 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:242: rados_get_data_bad_size: set_size obj-size-70936-0-256 td/test-erasure-eio 1 256 add 2026-02-17T08:31:52.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:192: set_size: local objname=obj-size-70936-0-256 2026-02-17T08:31:52.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:193: set_size: shift 2026-02-17T08:31:52.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:194: set_size: local dir=td/test-erasure-eio 2026-02-17T08:31:52.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:195: set_size: shift 2026-02-17T08:31:52.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:196: set_size: local shard_id=1 2026-02-17T08:31:52.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:197: set_size: shift 2026-02-17T08:31:52.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:198: set_size: local bytes=256 2026-02-17T08:31:52.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:199: set_size: shift 2026-02-17T08:31:52.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:200: set_size: local mode=add 2026-02-17T08:31:52.956 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local poolname=pool-jerasure 2026-02-17T08:31:52.956 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: get_osds pool-jerasure obj-size-70936-0-256 2026-02-17T08:31:52.957 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:31:52.957 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj-size-70936-0-256 2026-02-17T08:31:52.957 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj-size-70936-0-256 2026-02-17T08:31:52.957 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:31:53.151 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:31:53.151 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:31:53.151 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:31:53.151 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 2 2026-02-17T08:31:53.151 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: initial_osds=('3' '1' '2') 2026-02-17T08:31:53.151 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: local -a initial_osds 2026-02-17T08:31:53.152 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local osd_id=1 2026-02-17T08:31:53.152 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: ceph osd set noout 2026-02-17T08:31:53.419 INFO:tasks.workunit.client.0.trial059.stderr:noout is set 2026-02-17T08:31:53.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: '[' add = add ']' 2026-02-17T08:31:53.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: objectstore_tool td/test-erasure-eio 1 obj-size-70936-0-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:31:53.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1297: objectstore_tool: local dir=td/test-erasure-eio 2026-02-17T08:31:53.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: objectstore_tool: shift 2026-02-17T08:31:53.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1299: objectstore_tool: local id=1 2026-02-17T08:31:53.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: objectstore_tool: shift 2026-02-17T08:31:53.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-size-70936-0-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:31:53.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-17T08:31:53.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2026-02-17T08:31:53.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=1 2026-02-17T08:31:53.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2026-02-17T08:31:53.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-17T08:31:53.431 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:31:53.431 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:31:53.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:31:53.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:31:53.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:31:54.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:31:54.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-size-70936-0-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:31:54.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-17T08:31:54.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T08:31:54.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=1 2026-02-17T08:31:54.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T08:31:54.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-17T08:31:54.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-size-70936-0-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:31:55.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-17T08:31:55.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-eio 2026-02-17T08:31:55.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:31:55.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=1 2026-02-17T08:31:55.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:31:55.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-17T08:31:55.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:31:55.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:31:55.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:31:55.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:31:55.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-17T08:31:55.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-17T08:31:55.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:31:55.589 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:31:55.589 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:31:55.589 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:31:55.589 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:31:55.589 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:31:55.589 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:31:55.589 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:31:55.589 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:31:55.589 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:31:55.591 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:31:55.591 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:31:55.591 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:31:55.591 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:31:55.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:31:55.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:31:55.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:31:55.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:31:55.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:31:55.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:31:55.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-17T08:31:55.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.1 2026-02-17T08:31:55.592 INFO:tasks.workunit.client.0.trial059.stderr:start osd.1 2026-02-17T08:31:55.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:31:55.593 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-17T08:31:55.593 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 1 = 1 ']' 2026-02-17T08:31:55.593 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:31:55.593 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:31:55.593 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:31:55.604 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:31:55.584+0000 7fd5a7f2b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:31:55.605 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:31:55.588+0000 7fd5a7f2b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:31:55.606 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:31:55.588+0000 7fd5a7f2b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:31:55.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 1 2026-02-17T08:31:55.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:31:55.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:31:55.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:31:55.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:31:55.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:55.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:31:55.794 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:31:55.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:55.795 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:31:55.990 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:31:56.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:31:56.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:56.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:31:56.992 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:31:56.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:56.993 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:31:57.098 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:31:57.080+0000 7fd5a7f2b8c0 -1 Falling back to public interface 2026-02-17T08:31:57.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:31:58.192 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:31:58.192 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:58.192 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:31:58.192 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:31:58.192 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:58.193 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:31:58.389 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:31:59.391 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:31:59.391 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:31:59.391 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:31:59.391 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:31:59.391 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:31:59.391 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:31:59.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:00.068 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:00.048+0000 7fd5a7f2b8c0 -1 osd.1 86 log_to_monitors true 2026-02-17T08:32:00.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:00.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:00.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:32:00.584 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:32:00.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:00.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:32:00.781 INFO:tasks.workunit.client.0.trial059.stderr:osd.1 up in weight 1 up_from 92 up_thru 92 down_at 89 last_clean_interval [68,86) [v2:127.0.0.1:6810/104781627,v1:127.0.0.1:6811/104781627] [v2:127.0.0.1:6812/104781627,v1:127.0.0.1:6813/104781627] exists,up 3aa1ea6e-25cd-413e-9c15-7ab4f137ba65 2026-02-17T08:32:00.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:32:00.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:32:00.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:32:00.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: objectstore_tool: wait_for_clean 2026-02-17T08:32:00.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:32:00.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:32:00.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:32:00.782 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:32:00.783 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:32:00.783 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:32:00.783 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:32:00.783 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:32:00.783 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:32:00.888 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:32:00.888 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:32:00.888 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:32:00.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:32:00.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:32:00.889 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:32:01.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:32:01.096 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:32:01.096 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:32:01.096 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:32:01.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:32:01.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:32:01.096 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:32:01.170 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803816 2026-02-17T08:32:01.170 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803816 2026-02-17T08:32:01.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803816' 2026-02-17T08:32:01.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:32:01.171 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:32:01.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=395136991235 2026-02-17T08:32:01.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 395136991235 2026-02-17T08:32:01.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803816 1-395136991235' 2026-02-17T08:32:01.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:32:01.246 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:32:01.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411363 2026-02-17T08:32:01.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411363 2026-02-17T08:32:01.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803816 1-395136991235 2-77309411363' 2026-02-17T08:32:01.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:32:01.322 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:32:01.399 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=356482285575 2026-02-17T08:32:01.399 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 356482285575 2026-02-17T08:32:01.399 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803816 1-395136991235 2-77309411363 3-356482285575' 2026-02-17T08:32:01.399 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:32:01.400 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803816 2026-02-17T08:32:01.400 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:32:01.401 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:32:01.402 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803816 2026-02-17T08:32:01.402 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:32:01.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803816 2026-02-17T08:32:01.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803816' 2026-02-17T08:32:01.403 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.0 seq 25769803816 2026-02-17T08:32:01.404 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:32:01.596 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803814 -lt 25769803816 2026-02-17T08:32:01.596 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:32:02.597 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:32:02.598 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:32:02.797 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803816 -lt 25769803816 2026-02-17T08:32:02.797 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:32:02.798 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-395136991235 2026-02-17T08:32:02.798 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:32:02.799 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:32:02.800 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-395136991235 2026-02-17T08:32:02.800 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:32:02.801 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=395136991235 2026-02-17T08:32:02.801 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 395136991235' 2026-02-17T08:32:02.802 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.1 seq 395136991235 2026-02-17T08:32:02.802 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:32:02.999 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 395136991235 -lt 395136991235 2026-02-17T08:32:03.000 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:32:03.000 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-77309411363 2026-02-17T08:32:03.000 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:32:03.001 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:32:03.002 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-77309411363 2026-02-17T08:32:03.002 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:32:03.003 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411363 2026-02-17T08:32:03.003 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 77309411363' 2026-02-17T08:32:03.004 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.2 seq 77309411363 2026-02-17T08:32:03.004 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:32:03.215 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411363 -lt 77309411363 2026-02-17T08:32:03.216 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:32:03.216 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-356482285575 2026-02-17T08:32:03.216 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:32:03.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:32:03.218 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-356482285575 2026-02-17T08:32:03.218 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:32:03.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=356482285575 2026-02-17T08:32:03.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 356482285575' 2026-02-17T08:32:03.220 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.3 seq 356482285575 2026-02-17T08:32:03.220 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:32:03.417 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 356482285575 -lt 356482285575 2026-02-17T08:32:03.418 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:32:03.419 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:32:03.419 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:32:03.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:32:03.674 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:32:03.674 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:32:03.674 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:32:03.674 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:32:03.675 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:32:03.675 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:32:03.675 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:32:03.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:32:03.865 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:32:03.866 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:32:03.866 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:32:04.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:32:04.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:32:04.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:32:04.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: dd if=/dev/urandom bs=256 count=1 2026-02-17T08:32:04.118 INFO:tasks.workunit.client.0.trial059.stderr:1+0 records in 2026-02-17T08:32:04.118 INFO:tasks.workunit.client.0.trial059.stderr:1+0 records out 2026-02-17T08:32:04.118 INFO:tasks.workunit.client.0.trial059.stderr:256 bytes copied, 2.615e-05 s, 9.8 MB/s 2026-02-17T08:32:04.118 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: objectstore_tool td/test-erasure-eio 1 obj-size-70936-0-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:32:04.118 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1297: objectstore_tool: local dir=td/test-erasure-eio 2026-02-17T08:32:04.118 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: objectstore_tool: shift 2026-02-17T08:32:04.118 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1299: objectstore_tool: local id=1 2026-02-17T08:32:04.118 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: objectstore_tool: shift 2026-02-17T08:32:04.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-size-70936-0-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:32:04.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-17T08:32:04.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2026-02-17T08:32:04.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=1 2026-02-17T08:32:04.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2026-02-17T08:32:04.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-17T08:32:04.119 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:32:04.119 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:32:04.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:32:04.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:32:04.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:32:05.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:32:05.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-size-70936-0-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:32:05.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-17T08:32:05.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T08:32:05.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=1 2026-02-17T08:32:05.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T08:32:05.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-17T08:32:05.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-size-70936-0-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:32:06.589 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-17T08:32:06.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-eio 2026-02-17T08:32:06.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:32:06.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=1 2026-02-17T08:32:06.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:32:06.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-17T08:32:06.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:32:06.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:32:06.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:32:06.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:32:06.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-17T08:32:06.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-17T08:32:06.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:32:06.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:32:06.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:32:06.590 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:32:06.590 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:32:06.590 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:32:06.591 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:32:06.591 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:32:06.591 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:32:06.591 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:32:06.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:32:06.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:32:06.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:32:06.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:32:06.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:32:06.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:32:06.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:32:06.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:32:06.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:32:06.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:32:06.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-17T08:32:06.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.1 2026-02-17T08:32:06.593 INFO:tasks.workunit.client.0.trial059.stderr:start osd.1 2026-02-17T08:32:06.593 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:32:06.593 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-17T08:32:06.594 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 1 = 1 ']' 2026-02-17T08:32:06.595 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:32:06.595 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:32:06.595 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:32:06.611 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:06.593+0000 7f357136a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:06.612 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:06.597+0000 7f357136a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:06.613 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:06.597+0000 7f357136a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:06.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 1 2026-02-17T08:32:06.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:32:06.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:32:06.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:32:06.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:32:06.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:06.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:32:06.794 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:32:06.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:06.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:32:06.990 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:07.914 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:07.897+0000 7f357136a8c0 -1 Falling back to public interface 2026-02-17T08:32:07.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:07.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:07.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:32:07.992 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:32:07.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:07.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:32:08.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:09.188 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:09.188 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:09.188 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:32:09.188 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:32:09.189 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:09.189 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:32:09.384 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:10.385 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:10.385 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:10.385 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:32:10.385 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:32:10.385 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:10.385 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:32:10.581 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:10.915 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:10.897+0000 7f357136a8c0 -1 osd.1 93 log_to_monitors true 2026-02-17T08:32:11.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:11.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:11.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:32:11.583 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:32:11.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:11.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:32:11.777 INFO:tasks.workunit.client.0.trial059.stderr:osd.1 up in weight 1 up_from 97 up_thru 97 down_at 94 last_clean_interval [92,93) [v2:127.0.0.1:6810/2265864694,v1:127.0.0.1:6811/2265864694] [v2:127.0.0.1:6812/2265864694,v1:127.0.0.1:6813/2265864694] exists,up 3aa1ea6e-25cd-413e-9c15-7ab4f137ba65 2026-02-17T08:32:11.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:32:11.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:32:11.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:32:11.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: objectstore_tool: wait_for_clean 2026-02-17T08:32:11.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:32:11.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:32:11.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:32:11.778 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:32:11.779 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:32:11.779 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:32:11.779 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:32:11.779 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:32:11.779 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:32:11.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:32:11.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:32:11.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:32:11.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:32:11.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:32:11.881 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:32:12.079 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:32:12.079 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:32:12.079 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:32:12.080 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:32:12.080 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:32:12.080 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:32:12.080 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:32:12.154 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803820 2026-02-17T08:32:12.154 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803820 2026-02-17T08:32:12.155 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803820' 2026-02-17T08:32:12.155 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:32:12.155 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:32:12.230 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=416611827715 2026-02-17T08:32:12.230 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 416611827715 2026-02-17T08:32:12.230 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803820 1-416611827715' 2026-02-17T08:32:12.230 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:32:12.230 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:32:12.307 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411368 2026-02-17T08:32:12.307 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411368 2026-02-17T08:32:12.307 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803820 1-416611827715 2-77309411368' 2026-02-17T08:32:12.308 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:32:12.308 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:32:12.381 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=356482285579 2026-02-17T08:32:12.381 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 356482285579 2026-02-17T08:32:12.382 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803820 1-416611827715 2-77309411368 3-356482285579' 2026-02-17T08:32:12.382 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:32:12.382 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803820 2026-02-17T08:32:12.382 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:32:12.383 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:32:12.384 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803820 2026-02-17T08:32:12.384 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:32:12.385 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803820 2026-02-17T08:32:12.385 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803820' 2026-02-17T08:32:12.385 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.0 seq 25769803820 2026-02-17T08:32:12.386 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:32:12.579 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803820 -lt 25769803820 2026-02-17T08:32:12.580 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:32:12.580 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-416611827715 2026-02-17T08:32:12.580 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:32:12.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:32:12.582 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-416611827715 2026-02-17T08:32:12.582 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:32:12.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=416611827715 2026-02-17T08:32:12.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 416611827715' 2026-02-17T08:32:12.584 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.1 seq 416611827715 2026-02-17T08:32:12.584 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:32:12.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 1 -lt 416611827715 2026-02-17T08:32:12.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:32:13.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:32:13.783 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:32:13.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 1 -lt 416611827715 2026-02-17T08:32:13.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:32:14.980 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T08:32:14.981 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:32:15.182 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 416611827715 -lt 416611827715 2026-02-17T08:32:15.182 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:32:15.183 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-77309411368 2026-02-17T08:32:15.183 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:32:15.184 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:32:15.185 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-77309411368 2026-02-17T08:32:15.185 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:32:15.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411368 2026-02-17T08:32:15.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 77309411368' 2026-02-17T08:32:15.187 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.2 seq 77309411368 2026-02-17T08:32:15.187 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:32:15.392 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411368 -lt 77309411368 2026-02-17T08:32:15.392 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:32:15.393 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-356482285579 2026-02-17T08:32:15.393 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:32:15.394 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:32:15.395 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-356482285579 2026-02-17T08:32:15.395 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:32:15.396 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=356482285579 2026-02-17T08:32:15.396 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 356482285579' 2026-02-17T08:32:15.396 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.3 seq 356482285579 2026-02-17T08:32:15.397 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:32:15.593 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 356482285580 -lt 356482285579 2026-02-17T08:32:15.594 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:32:15.594 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:32:15.594 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:32:15.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:32:15.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:32:15.850 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:32:15.850 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:32:15.851 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:32:15.851 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:32:15.851 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:32:15.851 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:32:16.041 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:32:16.041 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:32:16.042 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:32:16.042 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:32:16.294 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:32:16.294 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:32:16.294 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:32:16.294 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:217: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-17T08:32:16.295 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:218: set_size: ceph osd unset noout 2026-02-17T08:32:16.564 INFO:tasks.workunit.client.0.trial059.stderr:noout is unset 2026-02-17T08:32:16.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:243: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-70936-0-256 fail 2026-02-17T08:32:16.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:32:16.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:32:16.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-70936-0-256 2026-02-17T08:32:16.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=fail 2026-02-17T08:32:16.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' fail = fail ']' 2026-02-17T08:32:16.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:114: rados_get: rados --pool pool-jerasure get obj-size-70936-0-256 td/test-erasure-eio/COPY 2026-02-17T08:32:16.591 INFO:tasks.workunit.client.0.trial059.stderr:error getting pool-jerasure/obj-size-70936-0-256: (5) Input/output error 2026-02-17T08:32:16.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:115: rados_get: return 2026-02-17T08:32:16.593 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:244: rados_get_data_bad_size: rm td/test-erasure-eio/ORIGINAL 2026-02-17T08:32:16.593 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:312: TEST_rados_get_bad_size_shard_0: delete_erasure_coded_pool pool-jerasure 2026-02-17T08:32:16.594 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:32:16.594 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-17T08:32:16.814 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' does not exist 2026-02-17T08:32:16.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-17T08:32:17.119 INFO:tasks.workunit.client.0.trial059.stderr:erasure-code-profile myprofile does not exist 2026-02-17T08:32:17.129 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-17T08:32:17.129 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:32:17.130 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:32:17.130 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:32:17.130 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:32:17.130 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:32:17.130 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:32:17.130 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:32:17.130 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:32:17.443 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:32:17.444 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:32:17.445 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:32:17.445 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:32:17.447 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:32:17.447 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:32:17.448 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:32:17.449 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:32:17.449 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:32:17.449 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:32:17.450 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:32:17.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:32:17.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:32:17.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:32:17.475 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:32:17.476 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:32:17.476 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:32:17.476 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:32:17.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:32:17.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:32:17.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-17T08:32:17.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-17T08:32:17.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-eio 2026-02-17T08:32:17.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-eio 2026-02-17T08:32:17.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:32:17.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:32:17.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:32:17.478 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:32:17.478 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:32:17.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:32:17.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:32:17.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:32:17.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:32:17.480 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:32:17.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:32:17.481 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:32:17.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:32:17.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:32:17.483 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:32:17.484 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:32:17.484 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:32:17.484 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:32:17.485 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:32:17.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:32:17.487 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:32:17.487 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:32:17.489 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:32:17.489 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:32:17.489 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:32:17.489 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:32:17.490 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:32:17.490 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:32:17.490 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-eio 2026-02-17T08:32:17.492 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:32:17.492 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:32:17.492 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:32:17.492 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.70936 2026-02-17T08:32:17.494 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:32:17.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:32:17.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:32:17.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-17T08:32:17.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-17T08:32:17.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-eio 2026-02-17T08:32:17.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:32:17.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:32:17.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:32:17.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-eio/a 2026-02-17T08:32:17.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-17T08:32:17.516 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:32:17.516 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:32:17.516 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:32:17.517 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:32:17.517 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:32:17.517 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:32:17.517 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:32:17.517 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T08:32:17.548 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:32:17.549 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:32:17.549 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:32:17.549 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:32:17.549 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:32:17.549 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:32:17.550 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:32:17.551 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:32:17.551 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:32:17.551 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:32:17.551 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:32:17.551 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:32:17.551 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:32:17.551 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:32:17.551 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get fsid 2026-02-17T08:32:17.607 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:32:17.608 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:32:17.608 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:32:17.608 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:32:17.608 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:32:17.609 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:32:17.609 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:32:17.609 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:32:17.609 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:32:17.609 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:32:17.610 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:32:17.610 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:32:17.610 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:32:17.610 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get mon_host 2026-02-17T08:32:17.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-17T08:32:17.665 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-eio 2026-02-17T08:32:17.665 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:32:17.665 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:32:17.665 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:32:17.665 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-eio/x 2026-02-17T08:32:17.665 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:32:17.774 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:32:17.774 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:32:17.774 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:32:17.774 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:32:17.774 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:32:17.774 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:32:17.775 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:32:17.775 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:32:17.776 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:32:17.795 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-17T08:32:17.795 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T08:32:17.900 INFO:tasks.workunit.client.0.trial059.stderr:pool 'rbd' already exists 2026-02-17T08:32:17.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:32:18.911 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-17T08:32:18.912 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:32:18.912 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:32:18.912 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:32:18.912 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:32:18.912 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:32:18.912 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:32:18.913 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-17T08:32:18.913 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-mon.a.asok log flush 2026-02-17T08:32:18.962 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:32:18.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-17T08:32:18.969 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:32:17.521+0000 7f379396cec0 0 load: jerasure load: lrc 2026-02-17T08:32:18.970 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_rados_get_bad_size_shard_1 td/test-erasure-eio 2026-02-17T08:32:18.970 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:316: TEST_rados_get_bad_size_shard_1: local dir=td/test-erasure-eio 2026-02-17T08:32:18.970 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:317: TEST_rados_get_bad_size_shard_1: setup_osds 4 2026-02-17T08:32:18.970 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=4 2026-02-17T08:32:18.970 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-17T08:32:18.970 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 4 - 1 2026-02-17T08:32:18.971 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 3 2026-02-17T08:32:18.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:32:18.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-17T08:32:18.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:32:18.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:32:18.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:32:18.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:32:18.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-17T08:32:18.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:32:18.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:32:18.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:32:18.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:32:18.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-17T08:32:18.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-17T08:32:18.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:32:18.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:32:18.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:32:18.976 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:32:18.976 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:32:18.976 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:32:18.976 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:32:18.976 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:32:18.976 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:32:18.976 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:32:18.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:32:18.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:32:18.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:32:18.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:32:18.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:32:18.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:32:18.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:32:18.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:32:18.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:32:18.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:32:18.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:32:18.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:32:18.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-17T08:32:18.978 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:32:18.978 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=4b36ab08-66a8-4017-8b4e-c7e709e2c352 2026-02-17T08:32:18.978 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 4b36ab08-66a8-4017-8b4e-c7e709e2c352' 2026-02-17T08:32:18.979 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 4b36ab08-66a8-4017-8b4e-c7e709e2c352 2026-02-17T08:32:18.979 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:32:18.988 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCSJ5Rpq40HOhAAs/QFR2iU3C4sfgirL9d4LA== 2026-02-17T08:32:18.988 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCSJ5Rpq40HOhAAs/QFR2iU3C4sfgirL9d4LA=="}' 2026-02-17T08:32:18.988 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 4b36ab08-66a8-4017-8b4e-c7e709e2c352 -i td/test-erasure-eio/0/new.json 2026-02-17T08:32:19.100 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:32:19.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-17T08:32:19.109 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCSJ5Rpq40HOhAAs/QFR2iU3C4sfgirL9d4LA== --osd-uuid 4b36ab08-66a8-4017-8b4e-c7e709e2c352 2026-02-17T08:32:19.125 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:19.109+0000 7f82974158c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:19.126 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:19.109+0000 7f82974158c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:19.127 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:19.109+0000 7f82974158c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:19.128 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:19.109+0000 7f82974158c0 -1 bdev(0x562715939c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:32:19.128 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:19.113+0000 7f82974158c0 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-17T08:32:21.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-17T08:32:21.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:32:21.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:32:21.662 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:32:21.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:32:21.934 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:32:21.934 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:32:21.935 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:32:21.935 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:32:21.935 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:32:21.935 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:32:21.956 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:21.941+0000 7f616a2cc8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:21.958 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:21.941+0000 7f616a2cc8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:21.959 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:21.941+0000 7f616a2cc8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:22.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:32:22.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:32:22.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:32:22.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:32:22.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:32:22.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:22.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:32:22.137 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:32:22.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:22.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:32:22.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:23.335 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:23.335 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:23.336 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:32:23.336 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:32:23.336 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:23.337 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:32:23.461 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:23.445+0000 7f616a2cc8c0 -1 Falling back to public interface 2026-02-17T08:32:23.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:24.533 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:24.533 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:24.534 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:32:24.534 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:32:24.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:24.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:32:24.729 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:25.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:25.730 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:25.731 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:32:25.731 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:32:25.731 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:25.732 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:32:25.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:26.710 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:26.693+0000 7f616a2cc8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:32:26.929 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:26.930 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:26.930 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:32:26.930 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:32:26.930 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:26.930 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:32:27.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:28.138 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:28.138 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:28.138 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:32:28.139 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:32:28.139 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:28.139 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:32:28.329 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2750480586,v1:127.0.0.1:6803/2750480586] [v2:127.0.0.1:6804/2750480586,v1:127.0.0.1:6805/2750480586] exists,up 4b36ab08-66a8-4017-8b4e-c7e709e2c352 2026-02-17T08:32:28.331 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:32:28.331 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:32:28.331 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:32:28.331 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:32:28.331 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-17T08:32:28.331 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:32:28.331 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:32:28.331 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T08:32:28.331 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:32:28.331 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-17T08:32:28.331 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:32:28.331 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:32:28.332 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:32:28.332 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:32:28.332 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-17T08:32:28.332 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-17T08:32:28.332 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:32:28.332 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:32:28.332 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:32:28.332 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:32:28.332 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:32:28.332 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:32:28.332 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:32:28.332 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:32:28.332 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:32:28.333 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:32:28.333 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:32:28.333 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:32:28.333 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:32:28.333 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:32:28.333 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:32:28.333 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:32:28.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:32:28.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:32:28.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:32:28.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:32:28.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:32:28.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:32:28.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-17T08:32:28.334 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:32:28.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=70e1b418-6980-4c27-bfd4-d33a78f26185 2026-02-17T08:32:28.334 INFO:tasks.workunit.client.0.trial059.stdout:add osd1 70e1b418-6980-4c27-bfd4-d33a78f26185 2026-02-17T08:32:28.335 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 70e1b418-6980-4c27-bfd4-d33a78f26185' 2026-02-17T08:32:28.335 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:32:28.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCcJ5RpZ1XTExAAwDyfYbNspcvLzV/15xjSAg== 2026-02-17T08:32:28.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCcJ5RpZ1XTExAAwDyfYbNspcvLzV/15xjSAg=="}' 2026-02-17T08:32:28.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 70e1b418-6980-4c27-bfd4-d33a78f26185 -i td/test-erasure-eio/1/new.json 2026-02-17T08:32:28.548 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:32:28.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-17T08:32:28.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCcJ5RpZ1XTExAAwDyfYbNspcvLzV/15xjSAg== --osd-uuid 70e1b418-6980-4c27-bfd4-d33a78f26185 2026-02-17T08:32:28.575 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:28.557+0000 7fbc960788c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:28.576 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:28.561+0000 7fbc960788c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:28.578 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:28.561+0000 7fbc960788c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:28.578 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:28.561+0000 7fbc960788c0 -1 bdev(0x564f7d475c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-17T08:32:28.578 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:28.561+0000 7fbc960788c0 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-17T08:32:30.852 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-17T08:32:30.852 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:32:30.853 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T08:32:30.853 INFO:tasks.workunit.client.0.trial059.stdout:adding osd1 key to auth repository 2026-02-17T08:32:30.853 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:32:31.118 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T08:32:31.118 INFO:tasks.workunit.client.0.trial059.stdout:start osd.1 2026-02-17T08:32:31.118 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:32:31.118 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:32:31.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:32:31.119 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:32:31.141 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:31.125+0000 7fc8020f28c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:31.143 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:31.125+0000 7fc8020f28c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:31.144 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:31.129+0000 7fc8020f28c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:31.317 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T08:32:31.317 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:32:31.317 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:32:31.317 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:32:31.317 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:32:31.317 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:31.317 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:32:31.317 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:32:31.317 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:31.317 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:32:31.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:32.518 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:32.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:32.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:32:32.519 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:32:32.520 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:32.520 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:32:32.661 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:32.645+0000 7fc8020f28c0 -1 Falling back to public interface 2026-02-17T08:32:32.716 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:33.717 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:33.717 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:33.718 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:32:33.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:32:33.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:33.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:32:33.911 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:34.913 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:34.913 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:34.913 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:32:34.913 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:32:34.914 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:34.914 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:32:35.105 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:35.694 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:35.677+0000 7fc8020f28c0 -1 osd.1 0 log_to_monitors true 2026-02-17T08:32:36.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:36.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:36.107 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:32:36.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:32:36.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:36.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:32:36.307 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:37.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:37.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:37.309 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:32:37.310 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:32:37.310 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:37.310 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:32:37.509 INFO:tasks.workunit.client.0.trial059.stdout:osd.1 up in weight 1 up_from 12 up_thru 12 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2288014236,v1:127.0.0.1:6811/2288014236] [v2:127.0.0.1:6812/2288014236,v1:127.0.0.1:6813/2288014236] exists,up 70e1b418-6980-4c27-bfd4-d33a78f26185 2026-02-17T08:32:37.513 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:32:37.513 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:32:37.513 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:32:37.513 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:32:37.513 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-17T08:32:37.513 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:32:37.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:32:37.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T08:32:37.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:32:37.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-17T08:32:37.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:32:37.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:32:37.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:32:37.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:32:37.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-17T08:32:37.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-17T08:32:37.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:32:37.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:32:37.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:32:37.515 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:32:37.515 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:32:37.515 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:32:37.515 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:32:37.515 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:32:37.515 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:32:37.515 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:32:37.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:32:37.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:32:37.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:32:37.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:32:37.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:32:37.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:32:37.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:32:37.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:32:37.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:32:37.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:32:37.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:32:37.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:32:37.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-17T08:32:37.517 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:32:37.517 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=39c28187-604b-42a4-a57e-8da82c1b877d 2026-02-17T08:32:37.517 INFO:tasks.workunit.client.0.trial059.stdout:add osd2 39c28187-604b-42a4-a57e-8da82c1b877d 2026-02-17T08:32:37.518 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 39c28187-604b-42a4-a57e-8da82c1b877d' 2026-02-17T08:32:37.518 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:32:37.526 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQClJ5RpjrB6HhAAvBhqL2J9dOpbung5ymOw8g== 2026-02-17T08:32:37.526 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQClJ5RpjrB6HhAAvBhqL2J9dOpbung5ymOw8g=="}' 2026-02-17T08:32:37.526 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 39c28187-604b-42a4-a57e-8da82c1b877d -i td/test-erasure-eio/2/new.json 2026-02-17T08:32:37.731 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:32:37.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-17T08:32:37.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQClJ5RpjrB6HhAAvBhqL2J9dOpbung5ymOw8g== --osd-uuid 39c28187-604b-42a4-a57e-8da82c1b877d 2026-02-17T08:32:37.757 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:37.741+0000 7f2b84e178c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:37.758 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:37.741+0000 7f2b84e178c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:37.761 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:37.745+0000 7f2b84e178c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:37.762 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:37.745+0000 7f2b84e178c0 -1 bdev(0x56381ae7dc00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-17T08:32:37.762 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:37.745+0000 7f2b84e178c0 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-17T08:32:40.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-17T08:32:40.043 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:32:40.044 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T08:32:40.044 INFO:tasks.workunit.client.0.trial059.stdout:adding osd2 key to auth repository 2026-02-17T08:32:40.045 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:32:40.311 INFO:tasks.workunit.client.0.trial059.stdout:start osd.2 2026-02-17T08:32:40.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T08:32:40.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:32:40.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:32:40.312 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:32:40.312 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:32:40.336 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:40.321+0000 7f8951fca8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:40.338 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:40.321+0000 7f8951fca8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:40.339 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:40.321+0000 7f8951fca8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:40.511 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T08:32:40.511 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:32:40.511 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:32:40.512 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:32:40.512 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:32:40.512 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:40.512 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:32:40.513 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:32:40.513 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:40.513 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:32:40.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:41.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:41.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:41.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:32:41.714 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:32:41.714 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:41.714 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:32:41.913 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:42.065 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:42.049+0000 7f8951fca8c0 -1 Falling back to public interface 2026-02-17T08:32:42.914 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:42.915 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:42.915 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:32:42.915 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:32:42.916 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:42.916 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:32:43.110 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:44.111 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:44.111 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:44.111 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:32:44.112 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:32:44.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:44.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:32:44.306 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:45.083 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:45.065+0000 7f8951fca8c0 -1 osd.2 0 log_to_monitors true 2026-02-17T08:32:45.307 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:45.307 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:45.308 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:32:45.308 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:32:45.308 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:45.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:32:45.506 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:46.508 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:46.508 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:46.509 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:32:46.509 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:32:46.509 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:46.509 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:32:46.702 INFO:tasks.workunit.client.0.trial059.stdout:osd.2 up in weight 1 up_from 17 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1286408543,v1:127.0.0.1:6819/1286408543] [v2:127.0.0.1:6820/1286408543,v1:127.0.0.1:6821/1286408543] exists,up 39c28187-604b-42a4-a57e-8da82c1b877d 2026-02-17T08:32:46.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:32:46.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:32:46.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:32:46.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:32:46.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-17T08:32:46.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:32:46.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:32:46.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2026-02-17T08:32:46.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:32:46.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-17T08:32:46.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:32:46.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:32:46.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:32:46.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:32:46.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-17T08:32:46.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-17T08:32:46.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:32:46.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:32:46.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:32:46.704 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:32:46.704 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:32:46.704 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:32:46.704 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:32:46.704 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:32:46.704 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:32:46.704 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:32:46.704 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:32:46.704 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:32:46.704 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:32:46.704 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:32:46.705 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:32:46.705 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:32:46.705 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:32:46.705 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:32:46.705 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:32:46.705 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:32:46.705 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:32:46.705 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:32:46.705 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-17T08:32:46.706 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:32:46.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=9b5ec25d-dc21-4840-bcec-b83f492f6640 2026-02-17T08:32:46.706 INFO:tasks.workunit.client.0.trial059.stdout:add osd3 9b5ec25d-dc21-4840-bcec-b83f492f6640 2026-02-17T08:32:46.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 9b5ec25d-dc21-4840-bcec-b83f492f6640' 2026-02-17T08:32:46.707 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:32:46.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCuJ5RpCOMCKhAAGBDiTp35/7HI9PGDYUapWA== 2026-02-17T08:32:46.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCuJ5RpCOMCKhAAGBDiTp35/7HI9PGDYUapWA=="}' 2026-02-17T08:32:46.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 9b5ec25d-dc21-4840-bcec-b83f492f6640 -i td/test-erasure-eio/3/new.json 2026-02-17T08:32:46.923 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:32:46.932 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-17T08:32:46.933 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCuJ5RpCOMCKhAAGBDiTp35/7HI9PGDYUapWA== --osd-uuid 9b5ec25d-dc21-4840-bcec-b83f492f6640 2026-02-17T08:32:46.948 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:46.933+0000 7f8eb40378c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:46.950 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:46.933+0000 7f8eb40378c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:46.951 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:46.937+0000 7f8eb40378c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:46.951 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:46.937+0000 7f8eb40378c0 -1 bdev(0x559797ac3c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-17T08:32:46.951 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:46.937+0000 7f8eb40378c0 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-17T08:32:49.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-17T08:32:49.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:32:49.247 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2026-02-17T08:32:49.247 INFO:tasks.workunit.client.0.trial059.stdout:adding osd3 key to auth repository 2026-02-17T08:32:49.248 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:32:49.508 INFO:tasks.workunit.client.0.trial059.stdout:start osd.3 2026-02-17T08:32:49.509 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2026-02-17T08:32:49.509 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:32:49.509 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:32:49.509 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:32:49.509 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:32:49.530 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:49.514+0000 7f1b314568c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:49.532 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:49.518+0000 7f1b314568c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:49.532 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:49.518+0000 7f1b314568c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:32:49.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2026-02-17T08:32:49.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:32:49.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T08:32:49.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:32:49.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:32:49.711 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:49.711 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:32:49.711 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:32:49.711 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:49.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:32:49.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:50.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:50.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:50.909 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:32:50.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:32:50.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:50.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:32:51.041 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:51.026+0000 7f1b314568c0 -1 Falling back to public interface 2026-02-17T08:32:51.106 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:52.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:52.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:52.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:32:52.107 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:32:52.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:52.108 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:32:52.302 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:53.303 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:53.303 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:53.304 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:32:53.304 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:32:53.305 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:53.305 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:32:53.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:54.079 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:32:54.066+0000 7f1b314568c0 -1 osd.3 0 log_to_monitors true 2026-02-17T08:32:54.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:54.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:54.498 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:32:54.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:32:54.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:54.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:32:54.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:32:55.697 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:32:55.698 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:32:55.698 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:32:55.699 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:32:55.699 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:32:55.699 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:32:55.893 INFO:tasks.workunit.client.0.trial059.stdout:osd.3 up in weight 1 up_from 25 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2532928578,v1:127.0.0.1:6827/2532928578] [v2:127.0.0.1:6828/2532928578,v1:127.0.0.1:6829/2532928578] exists,up 9b5ec25d-dc21-4840-bcec-b83f492f6640 2026-02-17T08:32:55.894 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:32:55.894 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:32:55.894 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:32:55.894 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-17T08:32:55.894 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:32:55.894 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:32:55.894 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:32:55.895 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:32:55.895 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:32:55.895 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.0.asok 2026-02-17T08:32:55.895 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-17T08:32:55.895 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.0.asok log flush 2026-02-17T08:32:55.956 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:32:55.961 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-17T08:32:55.963 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:32:23.449+0000 7f616a2cc8c0 0 load: jerasure load: lrc 2026-02-17T08:32:55.964 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:319: TEST_rados_get_bad_size_shard_1: local poolname=pool-jerasure 2026-02-17T08:32:55.964 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:320: TEST_rados_get_bad_size_shard_1: create_erasure_coded_pool pool-jerasure 2 1 2026-02-17T08:32:55.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:32:55.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-17T08:32:55.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=2 2026-02-17T08:32:55.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-17T08:32:55.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=1 2026-02-17T08:32:55.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-17T08:32:55.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=2 m=1 crush-failure-domain=osd 2026-02-17T08:32:56.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-17T08:32:56.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-17T08:32:56.571 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' already exists 2026-02-17T08:32:56.580 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:32:57.581 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-17T08:32:57.581 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:32:57.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:32:57.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:32:57.582 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:32:57.583 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:32:57.583 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:32:57.583 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:32:57.583 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:32:57.583 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:32:57.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:32:57.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:32:57.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:32:57.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:32:57.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:32:57.690 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:32:57.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:32:57.889 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:32:57.889 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:32:57.889 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:32:57.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:32:57.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:32:57.889 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:32:57.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803785 2026-02-17T08:32:57.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803785 2026-02-17T08:32:57.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803785' 2026-02-17T08:32:57.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:32:57.965 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:32:58.040 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=51539607559 2026-02-17T08:32:58.040 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 51539607559 2026-02-17T08:32:58.040 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803785 1-51539607559' 2026-02-17T08:32:58.040 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:32:58.040 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:32:58.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=73014444037 2026-02-17T08:32:58.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 73014444037 2026-02-17T08:32:58.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803785 1-51539607559 2-73014444037' 2026-02-17T08:32:58.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:32:58.115 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:32:58.189 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=107374182403 2026-02-17T08:32:58.189 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 107374182403 2026-02-17T08:32:58.189 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803785 1-51539607559 2-73014444037 3-107374182403' 2026-02-17T08:32:58.189 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:32:58.190 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803785 2026-02-17T08:32:58.190 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:32:58.191 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:32:58.192 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803785 2026-02-17T08:32:58.192 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:32:58.193 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803785 2026-02-17T08:32:58.194 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803785' 2026-02-17T08:32:58.194 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 25769803785 2026-02-17T08:32:58.194 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:32:58.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803785 -lt 25769803785 2026-02-17T08:32:58.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:32:58.404 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-51539607559 2026-02-17T08:32:58.404 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:32:58.405 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:32:58.406 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-51539607559 2026-02-17T08:32:58.406 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:32:58.407 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=51539607559 2026-02-17T08:32:58.407 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 51539607559 2026-02-17T08:32:58.407 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 51539607559' 2026-02-17T08:32:58.408 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:32:58.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 51539607557 -lt 51539607559 2026-02-17T08:32:58.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:32:59.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:32:59.611 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:32:59.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 51539607557 -lt 51539607559 2026-02-17T08:32:59.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:33:00.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T08:33:00.808 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:33:01.009 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 51539607559 -lt 51539607559 2026-02-17T08:33:01.009 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:33:01.010 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-73014444037 2026-02-17T08:33:01.010 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:33:01.011 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:33:01.012 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-73014444037 2026-02-17T08:33:01.012 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:33:01.013 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=73014444037 2026-02-17T08:33:01.013 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 73014444037' 2026-02-17T08:33:01.014 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 73014444037 2026-02-17T08:33:01.014 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:33:01.208 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 73014444037 -lt 73014444037 2026-02-17T08:33:01.209 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:33:01.209 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-107374182403 2026-02-17T08:33:01.209 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:33:01.210 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:33:01.211 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-107374182403 2026-02-17T08:33:01.211 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:33:01.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=107374182403 2026-02-17T08:33:01.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 107374182403' 2026-02-17T08:33:01.213 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 107374182403 2026-02-17T08:33:01.213 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:33:01.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 107374182403 -lt 107374182403 2026-02-17T08:33:01.412 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:33:01.412 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:33:01.412 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:33:01.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:33:01.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:33:01.673 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:33:01.673 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:33:01.673 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:33:01.673 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:33:01.673 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:33:01.673 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:33:01.869 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:33:01.869 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:33:01.870 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:33:01.870 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:33:02.131 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:33:02.131 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:33:02.131 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:33:02.131 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:322: TEST_rados_get_bad_size_shard_1: local shard_id=1 2026-02-17T08:33:02.131 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:323: TEST_rados_get_bad_size_shard_1: rados_get_data_bad_size td/test-erasure-eio 1 10 2026-02-17T08:33:02.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:222: rados_get_data_bad_size: local dir=td/test-erasure-eio 2026-02-17T08:33:02.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:223: rados_get_data_bad_size: shift 2026-02-17T08:33:02.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:224: rados_get_data_bad_size: local shard_id=1 2026-02-17T08:33:02.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:225: rados_get_data_bad_size: shift 2026-02-17T08:33:02.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: rados_get_data_bad_size: local bytes=10 2026-02-17T08:33:02.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: rados_get_data_bad_size: shift 2026-02-17T08:33:02.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: rados_get_data_bad_size: local mode=set 2026-02-17T08:33:02.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:230: rados_get_data_bad_size: local poolname=pool-jerasure 2026-02-17T08:33:02.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:231: rados_get_data_bad_size: local objname=obj-size-70936-1-10 2026-02-17T08:33:02.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:232: rados_get_data_bad_size: rados_put td/test-erasure-eio pool-jerasure obj-size-70936-1-10 2026-02-17T08:33:02.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-17T08:33:02.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-17T08:33:02.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-size-70936-1-10 2026-02-17T08:33:02.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:33:02.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-17T08:33:02.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:33:02.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-17T08:33:02.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:33:02.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-17T08:33:02.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:33:02.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-17T08:33:02.134 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-size-70936-1-10 td/test-erasure-eio/ORIGINAL 2026-02-17T08:33:02.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:236: rados_get_data_bad_size: set_size obj-size-70936-1-10 td/test-erasure-eio 1 10 set 2026-02-17T08:33:02.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:192: set_size: local objname=obj-size-70936-1-10 2026-02-17T08:33:02.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:193: set_size: shift 2026-02-17T08:33:02.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:194: set_size: local dir=td/test-erasure-eio 2026-02-17T08:33:02.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:195: set_size: shift 2026-02-17T08:33:02.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:196: set_size: local shard_id=1 2026-02-17T08:33:02.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:197: set_size: shift 2026-02-17T08:33:02.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:198: set_size: local bytes=10 2026-02-17T08:33:02.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:199: set_size: shift 2026-02-17T08:33:02.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:200: set_size: local mode=set 2026-02-17T08:33:02.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local poolname=pool-jerasure 2026-02-17T08:33:02.150 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: get_osds pool-jerasure obj-size-70936-1-10 2026-02-17T08:33:02.150 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:33:02.150 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj-size-70936-1-10 2026-02-17T08:33:02.150 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj-size-70936-1-10 2026-02-17T08:33:02.151 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:33:02.353 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:33:02.353 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:33:02.354 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:33:02.354 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 2 2026-02-17T08:33:02.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: initial_osds=('3' '1' '2') 2026-02-17T08:33:02.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: local -a initial_osds 2026-02-17T08:33:02.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local osd_id=1 2026-02-17T08:33:02.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: ceph osd set noout 2026-02-17T08:33:02.647 INFO:tasks.workunit.client.0.trial059.stderr:noout is set 2026-02-17T08:33:02.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: '[' set = add ']' 2026-02-17T08:33:02.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: '[' 10 = 0 ']' 2026-02-17T08:33:02.660 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: dd if=/dev/urandom bs=10 count=1 of=td/test-erasure-eio/CORRUPT 2026-02-17T08:33:02.662 INFO:tasks.workunit.client.0.trial059.stderr:1+0 records in 2026-02-17T08:33:02.662 INFO:tasks.workunit.client.0.trial059.stderr:1+0 records out 2026-02-17T08:33:02.662 INFO:tasks.workunit.client.0.trial059.stderr:10 bytes copied, 3.3333e-05 s, 300 kB/s 2026-02-17T08:33:02.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: objectstore_tool td/test-erasure-eio 1 obj-size-70936-1-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:33:02.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1297: objectstore_tool: local dir=td/test-erasure-eio 2026-02-17T08:33:02.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: objectstore_tool: shift 2026-02-17T08:33:02.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1299: objectstore_tool: local id=1 2026-02-17T08:33:02.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: objectstore_tool: shift 2026-02-17T08:33:02.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-size-70936-1-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:33:02.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-17T08:33:02.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2026-02-17T08:33:02.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=1 2026-02-17T08:33:02.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2026-02-17T08:33:02.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-17T08:33:02.663 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:33:02.664 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:33:02.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:33:02.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:33:02.664 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:33:03.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:33:03.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-size-70936-1-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:33:03.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-17T08:33:03.972 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T08:33:03.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=1 2026-02-17T08:33:03.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T08:33:03.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-17T08:33:03.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-size-70936-1-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:33:05.145 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-17T08:33:05.145 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-eio 2026-02-17T08:33:05.145 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:33:05.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=1 2026-02-17T08:33:05.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:33:05.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-17T08:33:05.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:33:05.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:33:05.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:33:05.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:33:05.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-17T08:33:05.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-17T08:33:05.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:33:05.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:33:05.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:33:05.147 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:33:05.147 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:33:05.147 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:33:05.149 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:33:05.149 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:33:05.149 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:33:05.149 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:33:05.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:33:05.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:33:05.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:33:05.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:33:05.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:33:05.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:33:05.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:33:05.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:33:05.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:33:05.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:33:05.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-17T08:33:05.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.1 2026-02-17T08:33:05.150 INFO:tasks.workunit.client.0.trial059.stderr:start osd.1 2026-02-17T08:33:05.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:33:05.150 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-17T08:33:05.151 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 1 = 1 ']' 2026-02-17T08:33:05.151 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:33:05.151 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:33:05.151 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:33:05.171 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:05.154+0000 7ff8fe5198c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:33:05.172 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:05.154+0000 7ff8fe5198c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:33:05.174 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:05.154+0000 7ff8fe5198c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:33:05.349 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 1 2026-02-17T08:33:05.349 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:33:05.349 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:33:05.350 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:33:05.350 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:33:05.350 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:05.350 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:33:05.350 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:33:05.350 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:05.350 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:33:05.546 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:33:06.404 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:06.386+0000 7ff8fe5198c0 -1 Falling back to public interface 2026-02-17T08:33:06.547 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:33:06.547 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:06.548 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:33:06.548 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:33:06.548 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:06.548 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:33:06.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:33:07.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:33:07.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:07.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:33:07.744 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:33:07.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:07.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:33:07.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:33:08.941 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:33:08.941 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:08.941 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:33:08.941 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:33:08.941 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:08.941 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:33:09.138 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:33:09.397 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:09.378+0000 7ff8fe5198c0 -1 osd.1 33 log_to_monitors true 2026-02-17T08:33:10.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:33:10.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:10.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:33:10.141 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:33:10.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:10.141 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:33:10.334 INFO:tasks.workunit.client.0.trial059.stderr:osd.1 up in weight 1 up_from 39 up_thru 39 down_at 36 last_clean_interval [12,33) [v2:127.0.0.1:6810/268459888,v1:127.0.0.1:6811/268459888] [v2:127.0.0.1:6812/268459888,v1:127.0.0.1:6813/268459888] exists,up 70e1b418-6980-4c27-bfd4-d33a78f26185 2026-02-17T08:33:10.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:33:10.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:33:10.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:33:10.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: objectstore_tool: wait_for_clean 2026-02-17T08:33:10.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:33:10.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:33:10.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:33:10.335 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:33:10.336 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:33:10.336 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:33:10.336 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:33:10.336 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:33:10.336 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:33:10.442 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:33:10.442 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:33:10.442 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:33:10.442 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:33:10.442 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:33:10.442 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:33:10.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:33:10.647 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:33:10.647 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:33:10.647 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:33:10.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:33:10.647 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:33:10.647 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:33:10.724 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803789 2026-02-17T08:33:10.724 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803789 2026-02-17T08:33:10.725 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803789' 2026-02-17T08:33:10.725 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:33:10.725 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:33:10.797 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=167503724547 2026-02-17T08:33:10.798 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 167503724547 2026-02-17T08:33:10.798 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803789 1-167503724547' 2026-02-17T08:33:10.798 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:33:10.798 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:33:10.872 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=73014444041 2026-02-17T08:33:10.872 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 73014444041 2026-02-17T08:33:10.872 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803789 1-167503724547 2-73014444041' 2026-02-17T08:33:10.872 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:33:10.873 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:33:10.946 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=107374182408 2026-02-17T08:33:10.946 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 107374182408 2026-02-17T08:33:10.946 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803789 1-167503724547 2-73014444041 3-107374182408' 2026-02-17T08:33:10.946 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:33:10.947 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803789 2026-02-17T08:33:10.947 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:33:10.947 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:33:10.948 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803789 2026-02-17T08:33:10.948 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:33:10.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803789 2026-02-17T08:33:10.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803789' 2026-02-17T08:33:10.950 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.0 seq 25769803789 2026-02-17T08:33:10.950 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:33:11.158 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803787 -lt 25769803789 2026-02-17T08:33:11.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:33:12.160 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:33:12.160 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:33:12.357 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803789 -lt 25769803789 2026-02-17T08:33:12.357 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:33:12.358 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-167503724547 2026-02-17T08:33:12.358 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:33:12.359 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:33:12.359 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-167503724547 2026-02-17T08:33:12.360 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:33:12.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=167503724547 2026-02-17T08:33:12.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 167503724547' 2026-02-17T08:33:12.361 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.1 seq 167503724547 2026-02-17T08:33:12.361 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:33:12.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 167503724547 -lt 167503724547 2026-02-17T08:33:12.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:33:12.568 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-73014444041 2026-02-17T08:33:12.569 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:33:12.569 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:33:12.570 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-73014444041 2026-02-17T08:33:12.570 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:33:12.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=73014444041 2026-02-17T08:33:12.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 73014444041' 2026-02-17T08:33:12.572 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.2 seq 73014444041 2026-02-17T08:33:12.572 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:33:12.776 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 73014444042 -lt 73014444041 2026-02-17T08:33:12.776 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:33:12.777 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-107374182408 2026-02-17T08:33:12.777 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:33:12.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:33:12.779 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-107374182408 2026-02-17T08:33:12.779 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:33:12.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=107374182408 2026-02-17T08:33:12.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 107374182408' 2026-02-17T08:33:12.781 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.3 seq 107374182408 2026-02-17T08:33:12.781 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:33:12.987 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 107374182408 -lt 107374182408 2026-02-17T08:33:12.988 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:33:12.988 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:33:12.989 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:33:13.249 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:33:13.249 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:33:13.249 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:33:13.250 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:33:13.250 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:33:13.250 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:33:13.250 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:33:13.250 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:33:13.447 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:33:13.447 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:33:13.448 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:33:13.448 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:33:13.711 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:33:13.711 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:33:13.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:33:13.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:217: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-17T08:33:13.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:218: set_size: ceph osd unset noout 2026-02-17T08:33:13.975 INFO:tasks.workunit.client.0.trial059.stderr:noout is unset 2026-02-17T08:33:13.985 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:238: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-70936-1-10 2026-02-17T08:33:13.985 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:33:13.985 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:33:13.985 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-70936-1-10 2026-02-17T08:33:13.985 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-17T08:33:13.985 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-17T08:33:13.985 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-size-70936-1-10 td/test-erasure-eio/COPY 2026-02-17T08:33:14.012 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-17T08:33:14.013 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-17T08:33:14.015 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:241: rados_get_data_bad_size: expr 1 + 1 2026-02-17T08:33:14.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:241: rados_get_data_bad_size: shard_id=2 2026-02-17T08:33:14.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:242: rados_get_data_bad_size: set_size obj-size-70936-1-10 td/test-erasure-eio 2 10 set 2026-02-17T08:33:14.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:192: set_size: local objname=obj-size-70936-1-10 2026-02-17T08:33:14.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:193: set_size: shift 2026-02-17T08:33:14.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:194: set_size: local dir=td/test-erasure-eio 2026-02-17T08:33:14.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:195: set_size: shift 2026-02-17T08:33:14.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:196: set_size: local shard_id=2 2026-02-17T08:33:14.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:197: set_size: shift 2026-02-17T08:33:14.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:198: set_size: local bytes=10 2026-02-17T08:33:14.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:199: set_size: shift 2026-02-17T08:33:14.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:200: set_size: local mode=set 2026-02-17T08:33:14.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local poolname=pool-jerasure 2026-02-17T08:33:14.018 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: get_osds pool-jerasure obj-size-70936-1-10 2026-02-17T08:33:14.018 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:33:14.018 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj-size-70936-1-10 2026-02-17T08:33:14.019 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj-size-70936-1-10 2026-02-17T08:33:14.019 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:33:14.217 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:33:14.218 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:33:14.218 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:33:14.218 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 2 2026-02-17T08:33:14.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: initial_osds=('3' '1' '2') 2026-02-17T08:33:14.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: local -a initial_osds 2026-02-17T08:33:14.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local osd_id=2 2026-02-17T08:33:14.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: ceph osd set noout 2026-02-17T08:33:14.482 INFO:tasks.workunit.client.0.trial059.stderr:noout is set 2026-02-17T08:33:14.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: '[' set = add ']' 2026-02-17T08:33:14.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: '[' 10 = 0 ']' 2026-02-17T08:33:14.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:214: set_size: dd if=/dev/urandom bs=10 count=1 of=td/test-erasure-eio/CORRUPT 2026-02-17T08:33:14.495 INFO:tasks.workunit.client.0.trial059.stderr:1+0 records in 2026-02-17T08:33:14.495 INFO:tasks.workunit.client.0.trial059.stderr:1+0 records out 2026-02-17T08:33:14.495 INFO:tasks.workunit.client.0.trial059.stderr:10 bytes copied, 2.9295e-05 s, 341 kB/s 2026-02-17T08:33:14.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: objectstore_tool td/test-erasure-eio 2 obj-size-70936-1-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:33:14.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1297: objectstore_tool: local dir=td/test-erasure-eio 2026-02-17T08:33:14.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: objectstore_tool: shift 2026-02-17T08:33:14.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1299: objectstore_tool: local id=2 2026-02-17T08:33:14.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: objectstore_tool: shift 2026-02-17T08:33:14.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 2 obj-size-70936-1-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:33:14.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-17T08:33:14.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2026-02-17T08:33:14.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=2 2026-02-17T08:33:14.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2026-02-17T08:33:14.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-17T08:33:14.496 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:33:14.496 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:33:14.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:33:14.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:33:14.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:33:15.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:33:15.806 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 2 obj-size-70936-1-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:33:15.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-17T08:33:15.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T08:33:15.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=2 2026-02-17T08:33:15.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T08:33:15.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/2 2026-02-17T08:33:15.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/2 obj-size-70936-1-10 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:33:17.001 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 2 2026-02-17T08:33:17.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-eio 2026-02-17T08:33:17.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:33:17.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=2 2026-02-17T08:33:17.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:33:17.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-17T08:33:17.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:33:17.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:33:17.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:33:17.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:33:17.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-17T08:33:17.003 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-17T08:33:17.003 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:33:17.003 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:33:17.003 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:33:17.003 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:33:17.003 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:33:17.003 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:33:17.003 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:33:17.003 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:33:17.003 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:33:17.003 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:33:17.005 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:33:17.005 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:33:17.005 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:33:17.005 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:33:17.005 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:33:17.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:33:17.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:33:17.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:33:17.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:33:17.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:33:17.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-17T08:33:17.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.2 2026-02-17T08:33:17.006 INFO:tasks.workunit.client.0.trial059.stderr:start osd.2 2026-02-17T08:33:17.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:33:17.006 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-17T08:33:17.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 2 = 2 ']' 2026-02-17T08:33:17.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:33:17.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:33:17.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:33:17.025 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:17.006+0000 7fe66e14d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:33:17.026 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:17.010+0000 7fe66e14d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:33:17.028 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:17.010+0000 7fe66e14d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:33:17.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 2 2026-02-17T08:33:17.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:33:17.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:33:17.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:33:17.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:33:17.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:17.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:33:17.199 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:33:17.200 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:17.200 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:33:17.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:33:18.272 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:18.254+0000 7fe66e14d8c0 -1 Falling back to public interface 2026-02-17T08:33:18.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:33:18.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:18.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:33:18.411 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:33:18.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:18.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:33:18.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:33:19.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:33:19.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:19.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:33:19.610 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:33:19.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:19.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:33:19.808 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:33:20.809 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:33:20.810 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:20.810 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:33:20.810 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:33:20.810 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:20.810 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:33:21.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:33:21.324 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:21.306+0000 7fe66e14d8c0 -1 osd.2 45 log_to_monitors true 2026-02-17T08:33:22.010 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:33:22.010 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:22.011 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:33:22.011 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:33:22.011 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:22.011 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:33:22.213 INFO:tasks.workunit.client.0.trial059.stderr:osd.2 up in weight 1 up_from 49 up_thru 36 down_at 46 last_clean_interval [17,45) [v2:127.0.0.1:6818/473638182,v1:127.0.0.1:6819/473638182] [v2:127.0.0.1:6820/473638182,v1:127.0.0.1:6821/473638182] exists,up 39c28187-604b-42a4-a57e-8da82c1b877d 2026-02-17T08:33:22.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:33:22.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:33:22.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:33:22.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: objectstore_tool: wait_for_clean 2026-02-17T08:33:22.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:33:22.214 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:33:22.214 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:33:22.214 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:33:22.214 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:33:22.215 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:33:22.215 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:33:22.215 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:33:22.215 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:33:22.318 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:33:22.318 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:33:22.318 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:33:22.318 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:33:22.318 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:33:22.318 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:33:22.523 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:33:22.523 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:33:22.523 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:33:22.523 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:33:22.523 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:33:22.523 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:33:22.523 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:33:22.599 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803793 2026-02-17T08:33:22.600 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803793 2026-02-17T08:33:22.600 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793' 2026-02-17T08:33:22.600 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:33:22.600 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:33:22.676 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=167503724551 2026-02-17T08:33:22.676 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 167503724551 2026-02-17T08:33:22.676 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-167503724551' 2026-02-17T08:33:22.676 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:33:22.676 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:33:22.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=210453397507 2026-02-17T08:33:22.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 210453397507 2026-02-17T08:33:22.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-167503724551 2-210453397507' 2026-02-17T08:33:22.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:33:22.752 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:33:22.830 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=107374182412 2026-02-17T08:33:22.830 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 107374182412 2026-02-17T08:33:22.830 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-167503724551 2-210453397507 3-107374182412' 2026-02-17T08:33:22.831 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:33:22.831 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803793 2026-02-17T08:33:22.831 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:33:22.832 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:33:22.833 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803793 2026-02-17T08:33:22.833 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:33:22.835 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803793 2026-02-17T08:33:22.835 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803793' 2026-02-17T08:33:22.835 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.0 seq 25769803793 2026-02-17T08:33:22.835 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:33:23.035 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803791 -lt 25769803793 2026-02-17T08:33:23.035 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:33:24.036 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:33:24.037 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:33:24.235 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803794 -lt 25769803793 2026-02-17T08:33:24.235 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:33:24.236 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-167503724551 2026-02-17T08:33:24.236 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:33:24.237 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:33:24.238 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-167503724551 2026-02-17T08:33:24.238 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:33:24.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=167503724551 2026-02-17T08:33:24.240 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 167503724551' 2026-02-17T08:33:24.240 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.1 seq 167503724551 2026-02-17T08:33:24.240 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:33:24.444 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 167503724551 -lt 167503724551 2026-02-17T08:33:24.444 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:33:24.445 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-210453397507 2026-02-17T08:33:24.445 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:33:24.446 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:33:24.447 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-210453397507 2026-02-17T08:33:24.447 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:33:24.449 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=210453397507 2026-02-17T08:33:24.449 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 210453397507' 2026-02-17T08:33:24.449 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.2 seq 210453397507 2026-02-17T08:33:24.449 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:33:24.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 210453397507 -lt 210453397507 2026-02-17T08:33:24.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:33:24.658 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-107374182412 2026-02-17T08:33:24.658 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:33:24.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:33:24.660 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-107374182412 2026-02-17T08:33:24.660 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:33:24.661 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=107374182412 2026-02-17T08:33:24.662 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 107374182412' 2026-02-17T08:33:24.662 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.3 seq 107374182412 2026-02-17T08:33:24.662 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:33:24.871 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 107374182412 -lt 107374182412 2026-02-17T08:33:24.871 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:33:24.872 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:33:24.872 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:33:25.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:33:25.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:33:25.127 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:33:25.127 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:33:25.127 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:33:25.127 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:33:25.127 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:33:25.127 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:33:25.319 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:33:25.320 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:33:25.320 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:33:25.320 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:33:25.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:33:25.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:33:25.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:33:25.575 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:217: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-17T08:33:25.576 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:218: set_size: ceph osd unset noout 2026-02-17T08:33:25.842 INFO:tasks.workunit.client.0.trial059.stderr:noout is unset 2026-02-17T08:33:25.852 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:243: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-70936-1-10 fail 2026-02-17T08:33:25.853 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:33:25.853 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:33:25.853 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-70936-1-10 2026-02-17T08:33:25.853 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=fail 2026-02-17T08:33:25.853 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' fail = fail ']' 2026-02-17T08:33:25.853 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:114: rados_get: rados --pool pool-jerasure get obj-size-70936-1-10 td/test-erasure-eio/COPY 2026-02-17T08:33:25.877 INFO:tasks.workunit.client.0.trial059.stderr:error getting pool-jerasure/obj-size-70936-1-10: (5) Input/output error 2026-02-17T08:33:25.879 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:115: rados_get: return 2026-02-17T08:33:25.879 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:244: rados_get_data_bad_size: rm td/test-erasure-eio/ORIGINAL 2026-02-17T08:33:25.882 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:324: TEST_rados_get_bad_size_shard_1: rados_get_data_bad_size td/test-erasure-eio 1 0 2026-02-17T08:33:25.882 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:222: rados_get_data_bad_size: local dir=td/test-erasure-eio 2026-02-17T08:33:25.882 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:223: rados_get_data_bad_size: shift 2026-02-17T08:33:25.882 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:224: rados_get_data_bad_size: local shard_id=1 2026-02-17T08:33:25.882 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:225: rados_get_data_bad_size: shift 2026-02-17T08:33:25.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: rados_get_data_bad_size: local bytes=0 2026-02-17T08:33:25.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: rados_get_data_bad_size: shift 2026-02-17T08:33:25.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: rados_get_data_bad_size: local mode=set 2026-02-17T08:33:25.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:230: rados_get_data_bad_size: local poolname=pool-jerasure 2026-02-17T08:33:25.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:231: rados_get_data_bad_size: local objname=obj-size-70936-1-0 2026-02-17T08:33:25.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:232: rados_get_data_bad_size: rados_put td/test-erasure-eio pool-jerasure obj-size-70936-1-0 2026-02-17T08:33:25.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-17T08:33:25.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-17T08:33:25.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-size-70936-1-0 2026-02-17T08:33:25.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:33:25.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-17T08:33:25.884 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:33:25.884 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-17T08:33:25.884 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:33:25.884 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-17T08:33:25.884 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:33:25.884 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-17T08:33:25.884 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-size-70936-1-0 td/test-erasure-eio/ORIGINAL 2026-02-17T08:33:25.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:236: rados_get_data_bad_size: set_size obj-size-70936-1-0 td/test-erasure-eio 1 0 set 2026-02-17T08:33:25.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:192: set_size: local objname=obj-size-70936-1-0 2026-02-17T08:33:25.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:193: set_size: shift 2026-02-17T08:33:25.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:194: set_size: local dir=td/test-erasure-eio 2026-02-17T08:33:25.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:195: set_size: shift 2026-02-17T08:33:25.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:196: set_size: local shard_id=1 2026-02-17T08:33:25.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:197: set_size: shift 2026-02-17T08:33:25.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:198: set_size: local bytes=0 2026-02-17T08:33:25.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:199: set_size: shift 2026-02-17T08:33:25.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:200: set_size: local mode=set 2026-02-17T08:33:25.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local poolname=pool-jerasure 2026-02-17T08:33:25.906 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: get_osds pool-jerasure obj-size-70936-1-0 2026-02-17T08:33:25.906 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:33:25.906 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj-size-70936-1-0 2026-02-17T08:33:25.907 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj-size-70936-1-0 2026-02-17T08:33:25.907 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:33:26.105 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:33:26.105 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:33:26.106 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:33:26.106 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 2 2026-02-17T08:33:26.106 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: initial_osds=('3' '1' '2') 2026-02-17T08:33:26.106 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: local -a initial_osds 2026-02-17T08:33:26.106 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local osd_id=1 2026-02-17T08:33:26.106 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: ceph osd set noout 2026-02-17T08:33:26.401 INFO:tasks.workunit.client.0.trial059.stderr:noout is set 2026-02-17T08:33:26.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: '[' set = add ']' 2026-02-17T08:33:26.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: '[' 0 = 0 ']' 2026-02-17T08:33:26.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: touch td/test-erasure-eio/CORRUPT 2026-02-17T08:33:26.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: objectstore_tool td/test-erasure-eio 1 obj-size-70936-1-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:33:26.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1297: objectstore_tool: local dir=td/test-erasure-eio 2026-02-17T08:33:26.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: objectstore_tool: shift 2026-02-17T08:33:26.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1299: objectstore_tool: local id=1 2026-02-17T08:33:26.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: objectstore_tool: shift 2026-02-17T08:33:26.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-size-70936-1-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:33:26.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-17T08:33:26.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2026-02-17T08:33:26.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=1 2026-02-17T08:33:26.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2026-02-17T08:33:26.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-17T08:33:26.415 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:33:26.415 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:33:26.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:33:26.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:33:26.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:33:27.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:33:27.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-size-70936-1-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:33:27.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-17T08:33:27.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T08:33:27.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=1 2026-02-17T08:33:27.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T08:33:27.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-17T08:33:27.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-size-70936-1-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:33:28.901 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-17T08:33:28.901 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-eio 2026-02-17T08:33:28.901 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:33:28.901 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=1 2026-02-17T08:33:28.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:33:28.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-17T08:33:28.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:33:28.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:33:28.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:33:28.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:33:28.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-17T08:33:28.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-17T08:33:28.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:33:28.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:33:28.902 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:33:28.903 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:33:28.903 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:33:28.903 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:33:28.903 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:33:28.903 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:33:28.903 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:33:28.903 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:33:28.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:33:28.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:33:28.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:33:28.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:33:28.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:33:28.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:33:28.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:33:28.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:33:28.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:33:28.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:33:28.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-17T08:33:28.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.1 2026-02-17T08:33:28.906 INFO:tasks.workunit.client.0.trial059.stderr:start osd.1 2026-02-17T08:33:28.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:33:28.906 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-17T08:33:28.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 1 = 1 ']' 2026-02-17T08:33:28.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:33:28.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:33:28.907 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:33:28.921 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:28.902+0000 7f02949e68c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:33:28.923 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:28.906+0000 7f02949e68c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:33:28.923 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:28.906+0000 7f02949e68c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:33:29.101 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 1 2026-02-17T08:33:29.102 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:33:29.102 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:33:29.102 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:33:29.102 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:33:29.102 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:29.102 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:33:29.102 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:33:29.102 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:29.102 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:33:29.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:33:30.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:33:30.302 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:30.302 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:33:30.302 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:33:30.302 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:30.302 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:33:30.416 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:30.398+0000 7f02949e68c0 -1 Falling back to public interface 2026-02-17T08:33:30.501 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:33:31.503 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:33:31.503 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:31.503 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:33:31.503 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:33:31.504 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:31.504 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:33:31.704 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:33:32.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:33:32.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:32.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:33:32.706 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:33:32.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:32.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:33:32.903 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:33:33.439 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:33.422+0000 7f02949e68c0 -1 osd.1 52 log_to_monitors true 2026-02-17T08:33:33.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:33:33.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:33.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:33:33.906 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:33:33.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:33.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:33:34.105 INFO:tasks.workunit.client.0.trial059.stderr:osd.1 up in weight 1 up_from 58 up_thru 58 down_at 55 last_clean_interval [39,52) [v2:127.0.0.1:6810/3848956906,v1:127.0.0.1:6811/3848956906] [v2:127.0.0.1:6812/3848956906,v1:127.0.0.1:6813/3848956906] exists,up 70e1b418-6980-4c27-bfd4-d33a78f26185 2026-02-17T08:33:34.105 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:33:34.105 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:33:34.105 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:33:34.105 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: objectstore_tool: wait_for_clean 2026-02-17T08:33:34.106 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:33:34.106 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:33:34.106 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:33:34.106 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:33:34.107 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:33:34.107 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:33:34.107 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:33:34.107 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:33:34.107 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:33:34.215 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:33:34.215 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:33:34.215 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:33:34.215 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:33:34.215 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:33:34.215 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:33:34.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:33:34.411 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:33:34.411 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:33:34.411 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:33:34.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:33:34.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:33:34.411 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:33:34.487 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803798 2026-02-17T08:33:34.487 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803798 2026-02-17T08:33:34.488 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803798' 2026-02-17T08:33:34.488 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:33:34.488 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:33:34.562 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=249108103171 2026-02-17T08:33:34.562 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 249108103171 2026-02-17T08:33:34.562 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803798 1-249108103171' 2026-02-17T08:33:34.563 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:33:34.563 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:33:34.640 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=210453397511 2026-02-17T08:33:34.640 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 210453397511 2026-02-17T08:33:34.640 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803798 1-249108103171 2-210453397511' 2026-02-17T08:33:34.640 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:33:34.640 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:33:34.714 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=107374182416 2026-02-17T08:33:34.714 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 107374182416 2026-02-17T08:33:34.714 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803798 1-249108103171 2-210453397511 3-107374182416' 2026-02-17T08:33:34.714 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:33:34.715 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803798 2026-02-17T08:33:34.715 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:33:34.716 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:33:34.717 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803798 2026-02-17T08:33:34.717 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:33:34.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803798 2026-02-17T08:33:34.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803798' 2026-02-17T08:33:34.719 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.0 seq 25769803798 2026-02-17T08:33:34.719 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:33:34.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803796 -lt 25769803798 2026-02-17T08:33:34.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:33:35.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:33:35.919 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:33:36.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803798 -lt 25769803798 2026-02-17T08:33:36.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:33:36.122 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-249108103171 2026-02-17T08:33:36.123 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:33:36.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:33:36.125 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-249108103171 2026-02-17T08:33:36.125 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:33:36.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=249108103171 2026-02-17T08:33:36.127 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 249108103171' 2026-02-17T08:33:36.127 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.1 seq 249108103171 2026-02-17T08:33:36.127 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:33:36.322 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 249108103171 -lt 249108103171 2026-02-17T08:33:36.322 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:33:36.323 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-210453397511 2026-02-17T08:33:36.323 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:33:36.324 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:33:36.324 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-210453397511 2026-02-17T08:33:36.325 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:33:36.326 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=210453397511 2026-02-17T08:33:36.326 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 210453397511' 2026-02-17T08:33:36.327 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.2 seq 210453397511 2026-02-17T08:33:36.327 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:33:36.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 210453397511 -lt 210453397511 2026-02-17T08:33:36.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:33:36.533 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-107374182416 2026-02-17T08:33:36.533 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:33:36.534 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:33:36.535 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-107374182416 2026-02-17T08:33:36.535 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:33:36.536 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=107374182416 2026-02-17T08:33:36.536 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 107374182416' 2026-02-17T08:33:36.536 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.3 seq 107374182416 2026-02-17T08:33:36.537 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:33:36.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 107374182417 -lt 107374182416 2026-02-17T08:33:36.742 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:33:36.742 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:33:36.742 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:33:36.997 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:33:36.998 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:33:36.999 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:33:36.999 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:33:36.999 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:33:36.999 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:33:36.999 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:33:36.999 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:33:37.194 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:33:37.195 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:33:37.195 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:33:37.195 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:33:37.461 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:33:37.461 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:33:37.461 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:33:37.461 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:217: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-17T08:33:37.461 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:218: set_size: ceph osd unset noout 2026-02-17T08:33:37.724 INFO:tasks.workunit.client.0.trial059.stderr:noout is unset 2026-02-17T08:33:37.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:238: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-70936-1-0 2026-02-17T08:33:37.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:33:37.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:33:37.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-70936-1-0 2026-02-17T08:33:37.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-17T08:33:37.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-17T08:33:37.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-size-70936-1-0 td/test-erasure-eio/COPY 2026-02-17T08:33:37.761 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-17T08:33:37.763 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-17T08:33:37.764 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:241: rados_get_data_bad_size: expr 1 + 1 2026-02-17T08:33:37.767 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:241: rados_get_data_bad_size: shard_id=2 2026-02-17T08:33:37.767 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:242: rados_get_data_bad_size: set_size obj-size-70936-1-0 td/test-erasure-eio 2 0 set 2026-02-17T08:33:37.767 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:192: set_size: local objname=obj-size-70936-1-0 2026-02-17T08:33:37.767 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:193: set_size: shift 2026-02-17T08:33:37.767 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:194: set_size: local dir=td/test-erasure-eio 2026-02-17T08:33:37.767 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:195: set_size: shift 2026-02-17T08:33:37.767 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:196: set_size: local shard_id=2 2026-02-17T08:33:37.767 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:197: set_size: shift 2026-02-17T08:33:37.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:198: set_size: local bytes=0 2026-02-17T08:33:37.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:199: set_size: shift 2026-02-17T08:33:37.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:200: set_size: local mode=set 2026-02-17T08:33:37.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local poolname=pool-jerasure 2026-02-17T08:33:37.768 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: get_osds pool-jerasure obj-size-70936-1-0 2026-02-17T08:33:37.768 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:33:37.768 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj-size-70936-1-0 2026-02-17T08:33:37.769 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj-size-70936-1-0 2026-02-17T08:33:37.769 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:33:37.967 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:33:37.967 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:33:37.967 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:33:37.967 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 2 2026-02-17T08:33:37.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: initial_osds=('3' '1' '2') 2026-02-17T08:33:37.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: local -a initial_osds 2026-02-17T08:33:37.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local osd_id=2 2026-02-17T08:33:37.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: ceph osd set noout 2026-02-17T08:33:38.232 INFO:tasks.workunit.client.0.trial059.stderr:noout is set 2026-02-17T08:33:38.243 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: '[' set = add ']' 2026-02-17T08:33:38.244 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:210: set_size: '[' 0 = 0 ']' 2026-02-17T08:33:38.244 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:212: set_size: touch td/test-erasure-eio/CORRUPT 2026-02-17T08:33:38.245 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: objectstore_tool td/test-erasure-eio 2 obj-size-70936-1-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:33:38.245 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1297: objectstore_tool: local dir=td/test-erasure-eio 2026-02-17T08:33:38.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: objectstore_tool: shift 2026-02-17T08:33:38.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1299: objectstore_tool: local id=2 2026-02-17T08:33:38.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: objectstore_tool: shift 2026-02-17T08:33:38.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 2 obj-size-70936-1-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:33:38.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-17T08:33:38.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2026-02-17T08:33:38.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=2 2026-02-17T08:33:38.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2026-02-17T08:33:38.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-17T08:33:38.247 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:33:38.247 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:33:38.247 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:33:38.247 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:33:38.247 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:33:39.556 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:33:39.556 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 2 obj-size-70936-1-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:33:39.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-17T08:33:39.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T08:33:39.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=2 2026-02-17T08:33:39.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T08:33:39.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/2 2026-02-17T08:33:39.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/2 obj-size-70936-1-0 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:33:40.745 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 2 2026-02-17T08:33:40.745 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-eio 2026-02-17T08:33:40.745 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:33:40.745 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=2 2026-02-17T08:33:40.745 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:33:40.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-17T08:33:40.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:33:40.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:33:40.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:33:40.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:33:40.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-17T08:33:40.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-17T08:33:40.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:33:40.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:33:40.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:33:40.746 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:33:40.746 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:33:40.747 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:33:40.747 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:33:40.747 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:33:40.747 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:33:40.749 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:33:40.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:33:40.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:33:40.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:33:40.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:33:40.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:33:40.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:33:40.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:33:40.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:33:40.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:33:40.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:33:40.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-17T08:33:40.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.2 2026-02-17T08:33:40.750 INFO:tasks.workunit.client.0.trial059.stderr:start osd.2 2026-02-17T08:33:40.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:33:40.750 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-17T08:33:40.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 2 = 2 ']' 2026-02-17T08:33:40.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:33:40.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:33:40.750 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:33:40.771 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:40.755+0000 7f49a19758c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:33:40.772 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:40.755+0000 7f49a19758c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:33:40.774 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:40.759+0000 7f49a19758c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:33:40.945 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 2 2026-02-17T08:33:40.945 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:33:40.945 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:33:40.945 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:33:40.945 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:33:40.945 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:40.945 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:33:40.945 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:33:40.946 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:40.946 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:33:41.147 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:33:41.979 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:41.963+0000 7f49a19758c0 -1 Falling back to public interface 2026-02-17T08:33:42.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:33:42.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:42.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:33:42.149 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:33:42.149 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:42.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:33:42.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:33:43.349 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:33:43.349 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:43.349 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:33:43.349 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:33:43.349 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:43.350 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:33:43.547 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:33:44.548 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:33:44.548 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:44.548 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:33:44.548 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:33:44.549 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:44.549 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:33:44.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:33:45.247 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:45.231+0000 7f49a19758c0 -1 osd.2 63 log_to_monitors true 2026-02-17T08:33:45.747 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:33:45.747 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:45.747 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:33:45.747 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:33:45.747 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:45.747 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:33:45.943 INFO:tasks.workunit.client.0.trial059.stderr:osd.2 up in weight 1 up_from 67 up_thru 55 down_at 64 last_clean_interval [49,63) [v2:127.0.0.1:6818/2475722593,v1:127.0.0.1:6819/2475722593] [v2:127.0.0.1:6820/2475722593,v1:127.0.0.1:6821/2475722593] exists,up 39c28187-604b-42a4-a57e-8da82c1b877d 2026-02-17T08:33:45.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:33:45.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:33:45.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:33:45.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: objectstore_tool: wait_for_clean 2026-02-17T08:33:45.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:33:45.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:33:45.944 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:33:45.945 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:33:45.946 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:33:45.946 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:33:45.946 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:33:45.946 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:33:45.946 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:33:46.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:33:46.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:33:46.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:33:46.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:33:46.051 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:33:46.051 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:33:46.254 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:33:46.254 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:33:46.254 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:33:46.254 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:33:46.254 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:33:46.254 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:33:46.254 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:33:46.328 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803802 2026-02-17T08:33:46.328 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803802 2026-02-17T08:33:46.328 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803802' 2026-02-17T08:33:46.329 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:33:46.329 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:33:46.406 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=249108103175 2026-02-17T08:33:46.406 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 249108103175 2026-02-17T08:33:46.406 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803802 1-249108103175' 2026-02-17T08:33:46.406 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:33:46.406 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:33:46.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=287762808835 2026-02-17T08:33:46.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 287762808835 2026-02-17T08:33:46.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803802 1-249108103175 2-287762808835' 2026-02-17T08:33:46.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:33:46.481 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:33:46.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=107374182421 2026-02-17T08:33:46.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 107374182421 2026-02-17T08:33:46.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803802 1-249108103175 2-287762808835 3-107374182421' 2026-02-17T08:33:46.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:33:46.556 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803802 2026-02-17T08:33:46.556 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:33:46.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:33:46.557 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803802 2026-02-17T08:33:46.558 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:33:46.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803802 2026-02-17T08:33:46.559 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803802' 2026-02-17T08:33:46.559 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.0 seq 25769803802 2026-02-17T08:33:46.560 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:33:46.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803800 -lt 25769803802 2026-02-17T08:33:46.766 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:33:47.767 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:33:47.768 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:33:47.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803800 -lt 25769803802 2026-02-17T08:33:47.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:33:48.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T08:33:48.967 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:33:49.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803803 -lt 25769803802 2026-02-17T08:33:49.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:33:49.167 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-249108103175 2026-02-17T08:33:49.167 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:33:49.168 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:33:49.169 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-249108103175 2026-02-17T08:33:49.169 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:33:49.170 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=249108103175 2026-02-17T08:33:49.170 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 249108103175' 2026-02-17T08:33:49.170 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.1 seq 249108103175 2026-02-17T08:33:49.171 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:33:49.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 249108103175 -lt 249108103175 2026-02-17T08:33:49.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:33:49.367 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-287762808835 2026-02-17T08:33:49.367 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:33:49.368 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:33:49.368 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-287762808835 2026-02-17T08:33:49.369 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:33:49.370 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=287762808835 2026-02-17T08:33:49.370 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 287762808835' 2026-02-17T08:33:49.370 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.2 seq 287762808835 2026-02-17T08:33:49.370 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:33:49.564 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 287762808835 -lt 287762808835 2026-02-17T08:33:49.565 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:33:49.565 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-107374182421 2026-02-17T08:33:49.565 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:33:49.566 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:33:49.567 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-107374182421 2026-02-17T08:33:49.567 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:33:49.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=107374182421 2026-02-17T08:33:49.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 107374182421' 2026-02-17T08:33:49.568 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.3 seq 107374182421 2026-02-17T08:33:49.569 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:33:49.764 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 107374182421 -lt 107374182421 2026-02-17T08:33:49.765 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:33:49.765 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:33:49.765 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:33:50.020 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:33:50.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:33:50.022 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:33:50.022 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:33:50.022 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:33:50.022 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:33:50.022 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:33:50.022 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:33:50.214 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:33:50.215 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:33:50.215 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:33:50.215 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:33:50.470 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:33:50.470 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:33:50.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:33:50.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:217: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-17T08:33:50.471 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:218: set_size: ceph osd unset noout 2026-02-17T08:33:50.737 INFO:tasks.workunit.client.0.trial059.stderr:noout is unset 2026-02-17T08:33:50.747 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:243: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-70936-1-0 fail 2026-02-17T08:33:50.747 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:33:50.747 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:33:50.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-70936-1-0 2026-02-17T08:33:50.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=fail 2026-02-17T08:33:50.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' fail = fail ']' 2026-02-17T08:33:50.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:114: rados_get: rados --pool pool-jerasure get obj-size-70936-1-0 td/test-erasure-eio/COPY 2026-02-17T08:33:50.771 INFO:tasks.workunit.client.0.trial059.stderr:error getting pool-jerasure/obj-size-70936-1-0: (5) Input/output error 2026-02-17T08:33:50.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:115: rados_get: return 2026-02-17T08:33:50.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:244: rados_get_data_bad_size: rm td/test-erasure-eio/ORIGINAL 2026-02-17T08:33:50.776 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:325: TEST_rados_get_bad_size_shard_1: rados_get_data_bad_size td/test-erasure-eio 1 256 add 2026-02-17T08:33:50.776 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:222: rados_get_data_bad_size: local dir=td/test-erasure-eio 2026-02-17T08:33:50.776 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:223: rados_get_data_bad_size: shift 2026-02-17T08:33:50.776 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:224: rados_get_data_bad_size: local shard_id=1 2026-02-17T08:33:50.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:225: rados_get_data_bad_size: shift 2026-02-17T08:33:50.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:226: rados_get_data_bad_size: local bytes=256 2026-02-17T08:33:50.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:227: rados_get_data_bad_size: shift 2026-02-17T08:33:50.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:228: rados_get_data_bad_size: local mode=add 2026-02-17T08:33:50.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:230: rados_get_data_bad_size: local poolname=pool-jerasure 2026-02-17T08:33:50.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:231: rados_get_data_bad_size: local objname=obj-size-70936-1-256 2026-02-17T08:33:50.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:232: rados_get_data_bad_size: rados_put td/test-erasure-eio pool-jerasure obj-size-70936-1-256 2026-02-17T08:33:50.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-17T08:33:50.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-17T08:33:50.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-size-70936-1-256 2026-02-17T08:33:50.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:33:50.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-17T08:33:50.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:33:50.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-17T08:33:50.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:33:50.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-17T08:33:50.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:33:50.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-17T08:33:50.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-size-70936-1-256 td/test-erasure-eio/ORIGINAL 2026-02-17T08:33:50.801 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:236: rados_get_data_bad_size: set_size obj-size-70936-1-256 td/test-erasure-eio 1 256 add 2026-02-17T08:33:50.801 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:192: set_size: local objname=obj-size-70936-1-256 2026-02-17T08:33:50.802 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:193: set_size: shift 2026-02-17T08:33:50.802 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:194: set_size: local dir=td/test-erasure-eio 2026-02-17T08:33:50.802 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:195: set_size: shift 2026-02-17T08:33:50.802 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:196: set_size: local shard_id=1 2026-02-17T08:33:50.802 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:197: set_size: shift 2026-02-17T08:33:50.802 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:198: set_size: local bytes=256 2026-02-17T08:33:50.802 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:199: set_size: shift 2026-02-17T08:33:50.802 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:200: set_size: local mode=add 2026-02-17T08:33:50.802 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local poolname=pool-jerasure 2026-02-17T08:33:50.802 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: get_osds pool-jerasure obj-size-70936-1-256 2026-02-17T08:33:50.803 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:33:50.803 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj-size-70936-1-256 2026-02-17T08:33:50.803 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj-size-70936-1-256 2026-02-17T08:33:50.803 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:33:51.001 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:33:51.002 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:33:51.002 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:33:51.002 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 2 2026-02-17T08:33:51.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: initial_osds=('3' '1' '2') 2026-02-17T08:33:51.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: local -a initial_osds 2026-02-17T08:33:51.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local osd_id=1 2026-02-17T08:33:51.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: ceph osd set noout 2026-02-17T08:33:51.299 INFO:tasks.workunit.client.0.trial059.stderr:noout is set 2026-02-17T08:33:51.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: '[' add = add ']' 2026-02-17T08:33:51.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: objectstore_tool td/test-erasure-eio 1 obj-size-70936-1-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:33:51.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1297: objectstore_tool: local dir=td/test-erasure-eio 2026-02-17T08:33:51.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: objectstore_tool: shift 2026-02-17T08:33:51.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1299: objectstore_tool: local id=1 2026-02-17T08:33:51.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: objectstore_tool: shift 2026-02-17T08:33:51.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-size-70936-1-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:33:51.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-17T08:33:51.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2026-02-17T08:33:51.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=1 2026-02-17T08:33:51.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2026-02-17T08:33:51.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-17T08:33:51.311 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:33:51.311 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:33:51.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:33:51.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:33:51.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:33:52.623 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:33:52.623 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-size-70936-1-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:33:52.623 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-17T08:33:52.623 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T08:33:52.623 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=1 2026-02-17T08:33:52.623 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T08:33:52.624 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-17T08:33:52.624 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-size-70936-1-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:33:53.472 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-17T08:33:53.473 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-eio 2026-02-17T08:33:53.473 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:33:53.473 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=1 2026-02-17T08:33:53.473 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:33:53.473 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-17T08:33:53.473 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:33:53.473 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:33:53.473 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:33:53.473 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:33:53.474 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-17T08:33:53.474 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-17T08:33:53.474 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:33:53.474 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:33:53.474 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:33:53.474 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:33:53.474 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:33:53.474 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:33:53.474 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:33:53.474 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:33:53.474 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:33:53.476 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:33:53.476 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:33:53.476 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:33:53.476 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:33:53.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:33:53.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:33:53.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:33:53.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:33:53.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:33:53.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:33:53.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:33:53.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-17T08:33:53.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.1 2026-02-17T08:33:53.477 INFO:tasks.workunit.client.0.trial059.stderr:start osd.1 2026-02-17T08:33:53.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:33:53.478 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-17T08:33:53.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 1 = 1 ']' 2026-02-17T08:33:53.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:33:53.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:33:53.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:33:53.498 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:53.483+0000 7f5da1edc8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:33:53.499 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:53.483+0000 7f5da1edc8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:33:53.500 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:53.483+0000 7f5da1edc8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:33:53.671 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 1 2026-02-17T08:33:53.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:33:53.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:33:53.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:33:53.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:33:53.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:53.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:33:53.672 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:33:53.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:53.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:33:53.873 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:33:54.875 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:33:54.875 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:54.875 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:33:54.875 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:33:54.875 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:54.875 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:33:54.987 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:54.971+0000 7f5da1edc8c0 -1 Falling back to public interface 2026-02-17T08:33:55.076 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:33:56.078 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:33:56.078 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:56.078 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:33:56.079 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:33:56.079 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:56.079 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:33:56.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:33:57.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:33:57.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:57.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:33:57.280 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:33:57.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:57.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:33:57.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:33:58.004 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:33:57.987+0000 7f5da1edc8c0 -1 osd.1 71 log_to_monitors true 2026-02-17T08:33:58.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:33:58.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:33:58.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:33:58.480 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:33:58.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:33:58.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:33:58.678 INFO:tasks.workunit.client.0.trial059.stderr:osd.1 up in weight 1 up_from 76 up_thru 76 down_at 73 last_clean_interval [58,71) [v2:127.0.0.1:6810/1404677005,v1:127.0.0.1:6811/1404677005] [v2:127.0.0.1:6812/1404677005,v1:127.0.0.1:6813/1404677005] exists,up 70e1b418-6980-4c27-bfd4-d33a78f26185 2026-02-17T08:33:58.678 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:33:58.679 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:33:58.679 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:33:58.679 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: objectstore_tool: wait_for_clean 2026-02-17T08:33:58.679 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:33:58.679 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:33:58.679 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:33:58.679 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:33:58.680 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:33:58.680 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:33:58.680 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:33:58.680 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:33:58.680 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:33:58.792 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:33:58.792 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:33:58.792 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:33:58.792 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:33:58.792 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:33:58.792 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:33:58.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:33:58.994 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:33:58.994 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:33:58.994 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:33:58.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:33:58.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:33:58.995 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:33:59.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803807 2026-02-17T08:33:59.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803807 2026-02-17T08:33:59.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803807' 2026-02-17T08:33:59.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:33:59.073 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:33:59.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=326417514499 2026-02-17T08:33:59.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 326417514499 2026-02-17T08:33:59.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803807 1-326417514499' 2026-02-17T08:33:59.148 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:33:59.148 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:33:59.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=287762808839 2026-02-17T08:33:59.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 287762808839 2026-02-17T08:33:59.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803807 1-326417514499 2-287762808839' 2026-02-17T08:33:59.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:33:59.224 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:33:59.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=107374182425 2026-02-17T08:33:59.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 107374182425 2026-02-17T08:33:59.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803807 1-326417514499 2-287762808839 3-107374182425' 2026-02-17T08:33:59.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:33:59.300 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803807 2026-02-17T08:33:59.300 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:33:59.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:33:59.301 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803807 2026-02-17T08:33:59.302 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:33:59.303 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803807 2026-02-17T08:33:59.303 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803807' 2026-02-17T08:33:59.303 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.0 seq 25769803807 2026-02-17T08:33:59.304 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:33:59.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803805 -lt 25769803807 2026-02-17T08:33:59.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:34:00.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:34:00.516 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:34:00.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803807 -lt 25769803807 2026-02-17T08:34:00.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:34:00.711 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-326417514499 2026-02-17T08:34:00.711 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:34:00.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:34:00.713 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-326417514499 2026-02-17T08:34:00.713 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:34:00.715 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=326417514499 2026-02-17T08:34:00.715 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 326417514499' 2026-02-17T08:34:00.715 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.1 seq 326417514499 2026-02-17T08:34:00.715 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:34:00.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 326417514499 -lt 326417514499 2026-02-17T08:34:00.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:34:00.917 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-287762808839 2026-02-17T08:34:00.918 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:34:00.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:34:00.919 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-287762808839 2026-02-17T08:34:00.919 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:34:00.920 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=287762808839 2026-02-17T08:34:00.921 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 287762808839' 2026-02-17T08:34:00.921 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.2 seq 287762808839 2026-02-17T08:34:00.921 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:34:01.128 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 287762808839 -lt 287762808839 2026-02-17T08:34:01.129 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:34:01.129 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-107374182425 2026-02-17T08:34:01.129 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:34:01.131 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:34:01.131 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-107374182425 2026-02-17T08:34:01.131 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:34:01.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=107374182425 2026-02-17T08:34:01.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 107374182425' 2026-02-17T08:34:01.133 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.3 seq 107374182425 2026-02-17T08:34:01.133 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:34:01.344 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 107374182425 -lt 107374182425 2026-02-17T08:34:01.344 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:34:01.345 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:34:01.345 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:34:01.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:34:01.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:34:01.609 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:34:01.609 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:34:01.609 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:34:01.609 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:34:01.609 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:34:01.609 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:34:01.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:34:01.808 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:34:01.808 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:34:01.808 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:34:02.069 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:34:02.069 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:34:02.069 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:34:02.070 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: dd if=/dev/urandom bs=256 count=1 2026-02-17T08:34:02.071 INFO:tasks.workunit.client.0.trial059.stderr:1+0 records in 2026-02-17T08:34:02.072 INFO:tasks.workunit.client.0.trial059.stderr:1+0 records out 2026-02-17T08:34:02.072 INFO:tasks.workunit.client.0.trial059.stderr:256 bytes copied, 2.2332e-05 s, 11.5 MB/s 2026-02-17T08:34:02.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: objectstore_tool td/test-erasure-eio 1 obj-size-70936-1-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:34:02.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1297: objectstore_tool: local dir=td/test-erasure-eio 2026-02-17T08:34:02.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: objectstore_tool: shift 2026-02-17T08:34:02.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1299: objectstore_tool: local id=1 2026-02-17T08:34:02.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: objectstore_tool: shift 2026-02-17T08:34:02.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-size-70936-1-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:34:02.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-17T08:34:02.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2026-02-17T08:34:02.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=1 2026-02-17T08:34:02.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2026-02-17T08:34:02.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-17T08:34:02.073 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:34:02.073 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:34:02.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:34:02.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:34:02.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:34:03.382 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:34:03.382 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-size-70936-1-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:34:03.382 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-17T08:34:03.382 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T08:34:03.382 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=1 2026-02-17T08:34:03.382 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T08:34:03.382 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-17T08:34:03.382 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-size-70936-1-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:34:04.552 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-17T08:34:04.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-eio 2026-02-17T08:34:04.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:34:04.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=1 2026-02-17T08:34:04.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:34:04.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-17T08:34:04.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:34:04.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:34:04.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:34:04.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:34:04.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-17T08:34:04.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-17T08:34:04.554 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:34:04.554 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:34:04.554 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:34:04.554 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:34:04.554 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:34:04.554 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:34:04.554 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:34:04.554 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:34:04.554 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:34:04.554 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:34:04.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:34:04.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:34:04.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:34:04.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:34:04.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:34:04.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:34:04.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:34:04.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:34:04.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:34:04.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:34:04.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-17T08:34:04.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.1 2026-02-17T08:34:04.558 INFO:tasks.workunit.client.0.trial059.stderr:start osd.1 2026-02-17T08:34:04.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:34:04.558 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-17T08:34:04.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 1 = 1 ']' 2026-02-17T08:34:04.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:34:04.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:34:04.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:34:04.574 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:04.559+0000 7fc8ae31c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:04.575 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:04.559+0000 7fc8ae31c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:04.576 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:04.559+0000 7fc8ae31c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:04.760 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 1 2026-02-17T08:34:04.760 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:34:04.760 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:34:04.760 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:34:04.760 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:34:04.761 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:04.761 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:34:04.761 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:34:04.761 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:04.761 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:34:04.962 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:34:05.815 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:05.799+0000 7fc8ae31c8c0 -1 Falling back to public interface 2026-02-17T08:34:05.964 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:34:05.964 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:05.964 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:34:05.964 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:34:05.964 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:05.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:34:06.160 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:34:07.161 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:34:07.162 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:07.162 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:34:07.162 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:34:07.162 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:07.162 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:34:07.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:34:08.362 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:34:08.363 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:08.363 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:34:08.363 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:34:08.363 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:08.363 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:34:08.561 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:34:08.886 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:08.871+0000 7fc8ae31c8c0 -1 osd.1 77 log_to_monitors true 2026-02-17T08:34:09.563 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:34:09.563 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:09.563 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:34:09.563 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:34:09.563 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:09.564 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:34:09.756 INFO:tasks.workunit.client.0.trial059.stderr:osd.1 up in weight 1 up_from 81 up_thru 81 down_at 78 last_clean_interval [76,77) [v2:127.0.0.1:6810/657014448,v1:127.0.0.1:6811/657014448] [v2:127.0.0.1:6812/657014448,v1:127.0.0.1:6813/657014448] exists,up 70e1b418-6980-4c27-bfd4-d33a78f26185 2026-02-17T08:34:09.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:34:09.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:34:09.757 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:34:09.757 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: objectstore_tool: wait_for_clean 2026-02-17T08:34:09.757 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:34:09.757 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:34:09.757 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:34:09.757 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:34:09.758 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:34:09.758 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:34:09.758 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:34:09.758 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:34:09.758 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:34:09.860 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:34:09.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:34:09.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:34:09.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:34:09.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:34:09.861 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:34:10.069 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:34:10.070 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:34:10.070 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:34:10.070 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:34:10.070 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:34:10.070 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:34:10.070 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:34:10.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803811 2026-02-17T08:34:10.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803811 2026-02-17T08:34:10.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803811' 2026-02-17T08:34:10.146 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:34:10.146 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:34:10.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=347892350979 2026-02-17T08:34:10.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 347892350979 2026-02-17T08:34:10.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803811 1-347892350979' 2026-02-17T08:34:10.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:34:10.224 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:34:10.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=287762808843 2026-02-17T08:34:10.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 287762808843 2026-02-17T08:34:10.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803811 1-347892350979 2-287762808843' 2026-02-17T08:34:10.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:34:10.298 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:34:10.374 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=107374182430 2026-02-17T08:34:10.375 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 107374182430 2026-02-17T08:34:10.375 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803811 1-347892350979 2-287762808843 3-107374182430' 2026-02-17T08:34:10.375 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:34:10.376 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803811 2026-02-17T08:34:10.376 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:34:10.376 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:34:10.377 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803811 2026-02-17T08:34:10.377 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:34:10.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803811 2026-02-17T08:34:10.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803811' 2026-02-17T08:34:10.379 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.0 seq 25769803811 2026-02-17T08:34:10.380 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:34:10.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803809 -lt 25769803811 2026-02-17T08:34:10.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:34:11.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:34:11.584 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:34:11.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803809 -lt 25769803811 2026-02-17T08:34:11.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:34:12.784 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T08:34:12.784 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:34:12.978 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803811 -lt 25769803811 2026-02-17T08:34:12.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:34:12.979 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-347892350979 2026-02-17T08:34:12.980 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:34:12.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:34:12.981 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-347892350979 2026-02-17T08:34:12.982 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:34:12.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=347892350979 2026-02-17T08:34:12.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 347892350979' 2026-02-17T08:34:12.983 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.1 seq 347892350979 2026-02-17T08:34:12.984 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:34:13.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 347892350979 -lt 347892350979 2026-02-17T08:34:13.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:34:13.195 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-287762808843 2026-02-17T08:34:13.195 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:34:13.197 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:34:13.198 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-287762808843 2026-02-17T08:34:13.198 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:34:13.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=287762808843 2026-02-17T08:34:13.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 287762808843' 2026-02-17T08:34:13.199 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.2 seq 287762808843 2026-02-17T08:34:13.200 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:34:13.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 287762808844 -lt 287762808843 2026-02-17T08:34:13.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:34:13.409 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-107374182430 2026-02-17T08:34:13.410 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:34:13.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:34:13.411 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-107374182430 2026-02-17T08:34:13.412 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:34:13.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=107374182430 2026-02-17T08:34:13.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 107374182430' 2026-02-17T08:34:13.413 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.3 seq 107374182430 2026-02-17T08:34:13.414 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:34:13.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 107374182430 -lt 107374182430 2026-02-17T08:34:13.607 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:34:13.607 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:34:13.607 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:34:13.864 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:34:13.864 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:34:13.865 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:34:13.865 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:34:13.865 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:34:13.865 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:34:13.865 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:34:13.865 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:34:14.056 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:34:14.057 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:34:14.057 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:34:14.057 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:34:14.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:34:14.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:34:14.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:34:14.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:217: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-17T08:34:14.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:218: set_size: ceph osd unset noout 2026-02-17T08:34:14.579 INFO:tasks.workunit.client.0.trial059.stderr:noout is unset 2026-02-17T08:34:14.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:238: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-70936-1-256 2026-02-17T08:34:14.591 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:34:14.591 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:34:14.591 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-70936-1-256 2026-02-17T08:34:14.591 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-17T08:34:14.591 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-17T08:34:14.591 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-size-70936-1-256 td/test-erasure-eio/COPY 2026-02-17T08:34:14.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-17T08:34:14.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-17T08:34:14.613 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:241: rados_get_data_bad_size: expr 1 + 1 2026-02-17T08:34:14.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:241: rados_get_data_bad_size: shard_id=2 2026-02-17T08:34:14.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:242: rados_get_data_bad_size: set_size obj-size-70936-1-256 td/test-erasure-eio 2 256 add 2026-02-17T08:34:14.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:192: set_size: local objname=obj-size-70936-1-256 2026-02-17T08:34:14.615 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:193: set_size: shift 2026-02-17T08:34:14.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:194: set_size: local dir=td/test-erasure-eio 2026-02-17T08:34:14.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:195: set_size: shift 2026-02-17T08:34:14.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:196: set_size: local shard_id=2 2026-02-17T08:34:14.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:197: set_size: shift 2026-02-17T08:34:14.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:198: set_size: local bytes=256 2026-02-17T08:34:14.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:199: set_size: shift 2026-02-17T08:34:14.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:200: set_size: local mode=add 2026-02-17T08:34:14.616 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:202: set_size: local poolname=pool-jerasure 2026-02-17T08:34:14.616 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: get_osds pool-jerasure obj-size-70936-1-256 2026-02-17T08:34:14.616 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:34:14.616 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj-size-70936-1-256 2026-02-17T08:34:14.617 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj-size-70936-1-256 2026-02-17T08:34:14.617 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:34:14.818 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:34:14.818 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:34:14.818 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:34:14.818 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 2 2026-02-17T08:34:14.818 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: initial_osds=('3' '1' '2') 2026-02-17T08:34:14.818 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:203: set_size: local -a initial_osds 2026-02-17T08:34:14.818 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:204: set_size: local osd_id=2 2026-02-17T08:34:14.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:205: set_size: ceph osd set noout 2026-02-17T08:34:15.083 INFO:tasks.workunit.client.0.trial059.stderr:noout is set 2026-02-17T08:34:15.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:206: set_size: '[' add = add ']' 2026-02-17T08:34:15.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:208: set_size: objectstore_tool td/test-erasure-eio 2 obj-size-70936-1-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:34:15.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1297: objectstore_tool: local dir=td/test-erasure-eio 2026-02-17T08:34:15.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: objectstore_tool: shift 2026-02-17T08:34:15.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1299: objectstore_tool: local id=2 2026-02-17T08:34:15.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: objectstore_tool: shift 2026-02-17T08:34:15.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 2 obj-size-70936-1-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:34:15.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-17T08:34:15.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2026-02-17T08:34:15.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=2 2026-02-17T08:34:15.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2026-02-17T08:34:15.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-17T08:34:15.097 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:34:15.097 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:34:15.097 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:34:15.097 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:34:15.097 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:34:16.407 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:34:16.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 2 obj-size-70936-1-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:34:16.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-17T08:34:16.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T08:34:16.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=2 2026-02-17T08:34:16.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T08:34:16.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/2 2026-02-17T08:34:16.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/2 obj-size-70936-1-256 get-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:34:17.255 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 2 2026-02-17T08:34:17.255 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-eio 2026-02-17T08:34:17.255 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:34:17.255 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=2 2026-02-17T08:34:17.255 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:34:17.255 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-17T08:34:17.255 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:34:17.255 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:34:17.255 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:34:17.256 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:34:17.256 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-17T08:34:17.256 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-17T08:34:17.256 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:34:17.256 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:34:17.256 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:34:17.256 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:34:17.256 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:34:17.256 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:34:17.258 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:34:17.258 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:34:17.258 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:34:17.258 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:34:17.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:34:17.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:34:17.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:34:17.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:34:17.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:34:17.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:34:17.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:34:17.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:34:17.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:34:17.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:34:17.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-17T08:34:17.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.2 2026-02-17T08:34:17.260 INFO:tasks.workunit.client.0.trial059.stderr:start osd.2 2026-02-17T08:34:17.260 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:34:17.260 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-17T08:34:17.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 2 = 2 ']' 2026-02-17T08:34:17.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:34:17.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:34:17.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:34:17.276 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:17.259+0000 7f3e30e4e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:17.277 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:17.263+0000 7f3e30e4e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:17.278 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:17.263+0000 7f3e30e4e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:17.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 2 2026-02-17T08:34:17.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:34:17.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:34:17.454 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:34:17.455 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:34:17.455 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:17.455 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:34:17.455 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:34:17.455 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:17.455 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:34:17.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:34:18.563 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:18.547+0000 7f3e30e4e8c0 -1 Falling back to public interface 2026-02-17T08:34:18.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:34:18.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:18.655 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:34:18.655 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:34:18.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:18.656 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:34:18.858 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:34:19.860 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:34:19.860 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:19.860 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:34:19.860 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:34:19.860 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:19.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:34:20.058 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:34:21.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:34:21.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:21.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:34:21.060 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:34:21.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:21.061 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:34:21.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:34:21.803 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:21.787+0000 7f3e30e4e8c0 -1 osd.2 85 log_to_monitors true 2026-02-17T08:34:22.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:34:22.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:22.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:34:22.261 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:34:22.262 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:22.262 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:34:22.458 INFO:tasks.workunit.client.0.trial059.stderr:osd.2 up in weight 1 up_from 90 up_thru 78 down_at 87 last_clean_interval [67,85) [v2:127.0.0.1:6818/2774725293,v1:127.0.0.1:6819/2774725293] [v2:127.0.0.1:6820/2774725293,v1:127.0.0.1:6821/2774725293] exists,up 39c28187-604b-42a4-a57e-8da82c1b877d 2026-02-17T08:34:22.459 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:34:22.459 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:34:22.459 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:34:22.459 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: objectstore_tool: wait_for_clean 2026-02-17T08:34:22.459 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:34:22.459 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:34:22.459 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:34:22.459 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:34:22.460 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:34:22.460 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:34:22.460 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:34:22.460 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:34:22.461 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:34:22.565 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:34:22.565 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:34:22.565 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:34:22.565 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:34:22.565 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:34:22.566 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:34:22.762 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:34:22.762 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:34:22.762 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:34:22.762 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:34:22.762 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:34:22.762 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:34:22.763 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:34:22.841 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803815 2026-02-17T08:34:22.841 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803815 2026-02-17T08:34:22.841 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803815' 2026-02-17T08:34:22.841 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:34:22.841 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:34:22.914 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=347892350983 2026-02-17T08:34:22.915 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 347892350983 2026-02-17T08:34:22.915 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803815 1-347892350983' 2026-02-17T08:34:22.915 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:34:22.915 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:34:22.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=386547056643 2026-02-17T08:34:22.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 386547056643 2026-02-17T08:34:22.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803815 1-347892350983 2-386547056643' 2026-02-17T08:34:22.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:34:22.991 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:34:23.064 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=107374182434 2026-02-17T08:34:23.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 107374182434 2026-02-17T08:34:23.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803815 1-347892350983 2-386547056643 3-107374182434' 2026-02-17T08:34:23.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:34:23.065 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803815 2026-02-17T08:34:23.066 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:34:23.066 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:34:23.067 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803815 2026-02-17T08:34:23.067 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:34:23.069 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803815 2026-02-17T08:34:23.069 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803815' 2026-02-17T08:34:23.069 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.0 seq 25769803815 2026-02-17T08:34:23.069 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:34:23.266 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803813 -lt 25769803815 2026-02-17T08:34:23.267 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:34:24.267 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:34:24.268 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:34:24.464 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803816 -lt 25769803815 2026-02-17T08:34:24.464 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:34:24.465 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-347892350983 2026-02-17T08:34:24.465 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:34:24.467 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:34:24.467 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-347892350983 2026-02-17T08:34:24.467 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:34:24.469 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=347892350983 2026-02-17T08:34:24.469 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 347892350983' 2026-02-17T08:34:24.469 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.1 seq 347892350983 2026-02-17T08:34:24.469 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:34:24.670 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 347892350984 -lt 347892350983 2026-02-17T08:34:24.670 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:34:24.671 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-386547056643 2026-02-17T08:34:24.671 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:34:24.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:34:24.673 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-386547056643 2026-02-17T08:34:24.673 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:34:24.675 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=386547056643 2026-02-17T08:34:24.675 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 386547056643' 2026-02-17T08:34:24.675 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.2 seq 386547056643 2026-02-17T08:34:24.675 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:34:24.882 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 386547056643 -lt 386547056643 2026-02-17T08:34:24.882 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:34:24.883 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-107374182434 2026-02-17T08:34:24.883 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:34:24.884 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:34:24.885 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-107374182434 2026-02-17T08:34:24.885 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:34:24.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=107374182434 2026-02-17T08:34:24.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 107374182434' 2026-02-17T08:34:24.886 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.3 seq 107374182434 2026-02-17T08:34:24.887 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:34:25.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 107374182434 -lt 107374182434 2026-02-17T08:34:25.087 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:34:25.088 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:34:25.088 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:34:25.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:34:25.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:34:25.341 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:34:25.342 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:34:25.342 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:34:25.342 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:34:25.342 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:34:25.342 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:34:25.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:34:25.531 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:34:25.532 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:34:25.532 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:34:25.785 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:34:25.785 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:34:25.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:34:25.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:209: set_size: dd if=/dev/urandom bs=256 count=1 2026-02-17T08:34:25.787 INFO:tasks.workunit.client.0.trial059.stderr:1+0 records in 2026-02-17T08:34:25.787 INFO:tasks.workunit.client.0.trial059.stderr:1+0 records out 2026-02-17T08:34:25.788 INFO:tasks.workunit.client.0.trial059.stderr:256 bytes copied, 2.2933e-05 s, 11.2 MB/s 2026-02-17T08:34:25.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:216: set_size: objectstore_tool td/test-erasure-eio 2 obj-size-70936-1-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:34:25.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1297: objectstore_tool: local dir=td/test-erasure-eio 2026-02-17T08:34:25.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: objectstore_tool: shift 2026-02-17T08:34:25.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1299: objectstore_tool: local id=2 2026-02-17T08:34:25.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: objectstore_tool: shift 2026-02-17T08:34:25.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 2 obj-size-70936-1-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:34:25.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-17T08:34:25.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2026-02-17T08:34:25.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=2 2026-02-17T08:34:25.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2026-02-17T08:34:25.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-17T08:34:25.789 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:34:25.789 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:34:25.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:34:25.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:34:25.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:34:27.097 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:34:27.097 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 2 obj-size-70936-1-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:34:27.097 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-17T08:34:27.097 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T08:34:27.097 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=2 2026-02-17T08:34:27.097 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T08:34:27.097 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/2 2026-02-17T08:34:27.097 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/2 obj-size-70936-1-256 set-bytes td/test-erasure-eio/CORRUPT 2026-02-17T08:34:28.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 2 2026-02-17T08:34:28.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-eio 2026-02-17T08:34:28.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:34:28.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=2 2026-02-17T08:34:28.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:34:28.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-17T08:34:28.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:34:28.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:34:28.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:34:28.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:34:28.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-17T08:34:28.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-17T08:34:28.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:34:28.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:34:28.286 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:34:28.286 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:34:28.286 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:34:28.286 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:34:28.286 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:34:28.286 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:34:28.286 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:34:28.286 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:34:28.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:34:28.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:34:28.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:34:28.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:34:28.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:34:28.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:34:28.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:34:28.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:34:28.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:34:28.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:34:28.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-17T08:34:28.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.2 2026-02-17T08:34:28.289 INFO:tasks.workunit.client.0.trial059.stderr:start osd.2 2026-02-17T08:34:28.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:34:28.289 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-17T08:34:28.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 2 = 2 ']' 2026-02-17T08:34:28.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:34:28.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:34:28.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:34:28.309 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:28.295+0000 7fb12af468c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:28.310 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:28.295+0000 7fb12af468c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:28.311 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:28.295+0000 7fb12af468c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:28.491 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 2 2026-02-17T08:34:28.491 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:34:28.492 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:34:28.492 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:34:28.492 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:34:28.492 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:28.492 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:34:28.492 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:34:28.492 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:28.492 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:34:28.690 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:34:29.603 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:29.587+0000 7fb12af468c0 -1 Falling back to public interface 2026-02-17T08:34:29.692 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:34:29.693 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:29.693 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:34:29.693 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:34:29.693 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:29.693 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:34:29.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:34:30.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:34:30.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:30.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:34:30.890 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:34:30.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:30.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:34:31.086 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:34:32.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:34:32.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:32.088 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:34:32.088 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:34:32.088 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:32.088 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:34:32.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:34:32.840 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:32.823+0000 7fb12af468c0 -1 osd.2 91 log_to_monitors true 2026-02-17T08:34:33.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:34:33.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:33.286 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:34:33.286 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:34:33.286 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:33.286 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:34:33.482 INFO:tasks.workunit.client.0.trial059.stderr:osd.2 up in weight 1 up_from 95 up_thru 78 down_at 92 last_clean_interval [90,91) [v2:127.0.0.1:6818/710466584,v1:127.0.0.1:6819/710466584] [v2:127.0.0.1:6820/710466584,v1:127.0.0.1:6821/710466584] exists,up 39c28187-604b-42a4-a57e-8da82c1b877d 2026-02-17T08:34:33.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:34:33.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:34:33.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:34:33.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: objectstore_tool: wait_for_clean 2026-02-17T08:34:33.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:34:33.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:34:33.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:34:33.483 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:34:33.483 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:34:33.483 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:34:33.483 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:34:33.483 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:34:33.483 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:34:33.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:34:33.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:34:33.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:34:33.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:34:33.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:34:33.587 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:34:33.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:34:33.786 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:34:33.786 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:34:33.786 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:34:33.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:34:33.786 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:34:33.787 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:34:33.862 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803820 2026-02-17T08:34:33.862 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803820 2026-02-17T08:34:33.862 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803820' 2026-02-17T08:34:33.862 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:34:33.863 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:34:33.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=347892350987 2026-02-17T08:34:33.941 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 347892350987 2026-02-17T08:34:33.941 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803820 1-347892350987' 2026-02-17T08:34:33.941 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:34:33.941 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:34:34.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=408021893123 2026-02-17T08:34:34.016 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 408021893123 2026-02-17T08:34:34.016 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803820 1-347892350987 2-408021893123' 2026-02-17T08:34:34.016 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:34:34.016 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:34:34.090 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=107374182438 2026-02-17T08:34:34.091 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 107374182438 2026-02-17T08:34:34.091 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803820 1-347892350987 2-408021893123 3-107374182438' 2026-02-17T08:34:34.091 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:34:34.092 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803820 2026-02-17T08:34:34.092 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:34:34.092 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:34:34.093 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803820 2026-02-17T08:34:34.093 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:34:34.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803820 2026-02-17T08:34:34.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803820' 2026-02-17T08:34:34.095 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.0 seq 25769803820 2026-02-17T08:34:34.095 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:34:34.297 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803820 -lt 25769803820 2026-02-17T08:34:34.297 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:34:34.298 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-347892350987 2026-02-17T08:34:34.298 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:34:34.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:34:34.300 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-347892350987 2026-02-17T08:34:34.300 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:34:34.302 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=347892350987 2026-02-17T08:34:34.302 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 347892350987' 2026-02-17T08:34:34.302 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.1 seq 347892350987 2026-02-17T08:34:34.302 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:34:34.502 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 347892350988 -lt 347892350987 2026-02-17T08:34:34.503 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:34:34.503 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-408021893123 2026-02-17T08:34:34.504 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:34:34.504 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:34:34.505 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-408021893123 2026-02-17T08:34:34.505 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:34:34.507 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=408021893123 2026-02-17T08:34:34.507 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 408021893123' 2026-02-17T08:34:34.507 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.2 seq 408021893123 2026-02-17T08:34:34.507 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:34:34.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 1 -lt 408021893123 2026-02-17T08:34:34.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:34:35.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:34:35.713 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:34:35.912 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 1 -lt 408021893123 2026-02-17T08:34:35.912 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:34:36.914 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T08:34:36.914 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:34:37.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 408021893123 -lt 408021893123 2026-02-17T08:34:37.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:34:37.114 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-107374182438 2026-02-17T08:34:37.114 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:34:37.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:34:37.116 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-107374182438 2026-02-17T08:34:37.117 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:34:37.118 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=107374182438 2026-02-17T08:34:37.118 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 107374182438' 2026-02-17T08:34:37.118 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.3 seq 107374182438 2026-02-17T08:34:37.118 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:34:37.322 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 107374182439 -lt 107374182438 2026-02-17T08:34:37.322 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:34:37.323 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:34:37.323 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:34:37.576 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:34:37.577 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:34:37.577 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:34:37.577 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:34:37.577 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:34:37.577 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:34:37.577 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:34:37.577 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:34:37.772 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:34:37.773 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:34:37.773 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:34:37.773 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:34:38.034 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:34:38.034 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:34:38.034 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:34:38.034 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:217: set_size: rm -f td/test-erasure-eio/CORRUPT 2026-02-17T08:34:38.035 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:218: set_size: ceph osd unset noout 2026-02-17T08:34:38.343 INFO:tasks.workunit.client.0.trial059.stderr:noout is unset 2026-02-17T08:34:38.356 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:243: rados_get_data_bad_size: rados_get td/test-erasure-eio pool-jerasure obj-size-70936-1-256 fail 2026-02-17T08:34:38.357 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:34:38.357 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:34:38.357 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-size-70936-1-256 2026-02-17T08:34:38.357 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=fail 2026-02-17T08:34:38.357 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' fail = fail ']' 2026-02-17T08:34:38.357 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:114: rados_get: rados --pool pool-jerasure get obj-size-70936-1-256 td/test-erasure-eio/COPY 2026-02-17T08:34:38.374 INFO:tasks.workunit.client.0.trial059.stderr:error getting pool-jerasure/obj-size-70936-1-256: (5) Input/output error 2026-02-17T08:34:38.376 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:115: rados_get: return 2026-02-17T08:34:38.376 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:244: rados_get_data_bad_size: rm td/test-erasure-eio/ORIGINAL 2026-02-17T08:34:38.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:326: TEST_rados_get_bad_size_shard_1: delete_erasure_coded_pool pool-jerasure 2026-02-17T08:34:38.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:34:38.377 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-17T08:34:38.593 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' does not exist 2026-02-17T08:34:38.602 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-17T08:34:38.860 INFO:tasks.workunit.client.0.trial059.stderr:erasure-code-profile myprofile does not exist 2026-02-17T08:34:38.870 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-17T08:34:38.870 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:34:38.870 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:34:38.870 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:34:38.870 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:34:38.870 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:34:38.870 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:34:38.871 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:34:38.871 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:34:39.181 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:34:39.182 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:34:39.183 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:34:39.184 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:34:39.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:34:39.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:34:39.186 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:34:39.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:34:39.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:34:39.188 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:34:39.188 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:34:39.189 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:34:39.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:34:39.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:34:39.215 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:34:39.215 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:34:39.215 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:34:39.215 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:34:39.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:34:39.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:34:39.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-17T08:34:39.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-17T08:34:39.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-eio 2026-02-17T08:34:39.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-eio 2026-02-17T08:34:39.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:34:39.217 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:34:39.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:34:39.218 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:34:39.218 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:34:39.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:34:39.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:34:39.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:34:39.221 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:34:39.221 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:34:39.222 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:34:39.222 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:34:39.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:34:39.223 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:34:39.223 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:34:39.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:34:39.224 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:34:39.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:34:39.225 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:34:39.226 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:34:39.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:34:39.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:34:39.229 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:34:39.229 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:34:39.229 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:34:39.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:34:39.230 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:34:39.230 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:34:39.230 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-eio 2026-02-17T08:34:39.232 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:34:39.232 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:34:39.232 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:34:39.232 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.70936 2026-02-17T08:34:39.233 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:34:39.234 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:34:39.234 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:34:39.234 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-17T08:34:39.234 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-17T08:34:39.235 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-eio 2026-02-17T08:34:39.235 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:34:39.235 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:34:39.235 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:34:39.235 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-eio/a 2026-02-17T08:34:39.235 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-17T08:34:39.256 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:34:39.256 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:34:39.256 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:34:39.256 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:34:39.256 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:34:39.256 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:34:39.257 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:34:39.257 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T08:34:39.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:34:39.286 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:34:39.286 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:34:39.286 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:34:39.286 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:34:39.287 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:34:39.287 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:34:39.287 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:34:39.287 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:34:39.288 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:34:39.288 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:34:39.288 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:34:39.288 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:34:39.288 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:34:39.288 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get fsid 2026-02-17T08:34:39.345 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:34:39.345 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:34:39.345 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:34:39.345 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:34:39.346 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:34:39.347 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:34:39.347 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:34:39.347 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:34:39.347 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:34:39.347 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:34:39.347 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:34:39.347 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:34:39.347 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:34:39.348 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get mon_host 2026-02-17T08:34:39.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-17T08:34:39.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-eio 2026-02-17T08:34:39.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:34:39.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:34:39.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:34:39.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-eio/x 2026-02-17T08:34:39.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:34:39.511 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:34:39.511 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:34:39.511 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:34:39.512 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:34:39.512 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:34:39.512 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:34:39.512 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:34:39.512 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:34:39.513 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:34:39.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-17T08:34:39.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T08:34:39.638 INFO:tasks.workunit.client.0.trial059.stderr:pool 'rbd' already exists 2026-02-17T08:34:39.646 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:34:40.649 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-17T08:34:40.649 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:34:40.649 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:34:40.649 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:34:40.649 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:34:40.649 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:34:40.649 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:34:40.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-17T08:34:40.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-mon.a.asok log flush 2026-02-17T08:34:40.699 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:34:40.704 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-17T08:34:40.706 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:34:39.259+0000 7f04f65dbec0 0 load: jerasure load: lrc 2026-02-17T08:34:40.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_rados_get_subread_eio_shard_0 td/test-erasure-eio 2026-02-17T08:34:40.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:255: TEST_rados_get_subread_eio_shard_0: local dir=td/test-erasure-eio 2026-02-17T08:34:40.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:256: TEST_rados_get_subread_eio_shard_0: setup_osds 4 2026-02-17T08:34:40.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=4 2026-02-17T08:34:40.707 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-17T08:34:40.707 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 4 - 1 2026-02-17T08:34:40.708 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 3 2026-02-17T08:34:40.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:34:40.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-17T08:34:40.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:34:40.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:34:40.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:34:40.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:34:40.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-17T08:34:40.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:34:40.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:34:40.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:34:40.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:34:40.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-17T08:34:40.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-17T08:34:40.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:34:40.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:34:40.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:34:40.713 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:34:40.713 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:34:40.713 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:34:40.714 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:34:40.714 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:34:40.714 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:34:40.714 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:34:40.714 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:34:40.714 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:34:40.714 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:34:40.715 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:34:40.715 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:34:40.715 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:34:40.715 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:34:40.715 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:34:40.715 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:34:40.715 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:34:40.715 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:34:40.715 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:34:40.715 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-17T08:34:40.716 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:34:40.716 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=0eb6604c-7bef-49c2-9a07-3ab5cb3791e1 2026-02-17T08:34:40.716 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 0eb6604c-7bef-49c2-9a07-3ab5cb3791e1' 2026-02-17T08:34:40.717 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 0eb6604c-7bef-49c2-9a07-3ab5cb3791e1 2026-02-17T08:34:40.717 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:34:40.725 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAgKJRpCCuNKhAAjJB8Q6mOZjVb/V9iAn8tdQ== 2026-02-17T08:34:40.725 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAgKJRpCCuNKhAAjJB8Q6mOZjVb/V9iAn8tdQ=="}' 2026-02-17T08:34:40.725 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 0eb6604c-7bef-49c2-9a07-3ab5cb3791e1 -i td/test-erasure-eio/0/new.json 2026-02-17T08:34:40.831 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:34:40.839 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-17T08:34:40.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAgKJRpCCuNKhAAjJB8Q6mOZjVb/V9iAn8tdQ== --osd-uuid 0eb6604c-7bef-49c2-9a07-3ab5cb3791e1 2026-02-17T08:34:40.854 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:40.839+0000 7eff93c0f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:40.856 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:40.839+0000 7eff93c0f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:40.857 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:40.843+0000 7eff93c0f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:40.857 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:40.843+0000 7eff93c0f8c0 -1 bdev(0x5635dd887c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:34:40.858 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:40.843+0000 7eff93c0f8c0 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-17T08:34:43.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-17T08:34:43.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:34:43.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:34:43.415 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:34:43.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:34:43.690 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:34:43.690 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:34:43.690 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:34:43.690 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:34:43.690 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:34:43.691 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:34:43.713 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:43.699+0000 7f1390be58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:43.715 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:43.699+0000 7f1390be58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:43.716 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:43.699+0000 7f1390be58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:43.888 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:34:43.888 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:34:43.888 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:34:43.888 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:34:43.888 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:34:43.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:43.889 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:34:43.889 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:34:43.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:43.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:34:44.086 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:34:45.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:34:45.088 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:45.088 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:34:45.089 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:34:45.089 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:45.089 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:34:45.262 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:45.247+0000 7f1390be58c0 -1 Falling back to public interface 2026-02-17T08:34:45.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:34:46.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:34:46.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:46.289 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:34:46.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:34:46.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:46.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:34:46.487 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:34:47.488 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:34:47.489 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:47.489 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:34:47.490 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:34:47.490 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:47.490 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:34:47.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:34:48.260 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:48.243+0000 7f1390be58c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:34:48.687 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:34:48.687 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:48.688 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:34:48.688 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:34:48.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:48.689 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:34:48.904 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 6 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1105130920,v1:127.0.0.1:6803/1105130920] [v2:127.0.0.1:6804/1105130920,v1:127.0.0.1:6805/1105130920] exists,up 0eb6604c-7bef-49c2-9a07-3ab5cb3791e1 2026-02-17T08:34:48.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:34:48.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:34:48.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:34:48.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:34:48.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-17T08:34:48.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:34:48.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:34:48.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T08:34:48.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:34:48.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-17T08:34:48.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:34:48.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:34:48.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:34:48.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:34:48.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-17T08:34:48.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-17T08:34:48.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:34:48.909 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:34:48.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:34:48.910 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:34:48.910 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:34:48.910 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:34:48.910 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:34:48.910 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:34:48.910 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:34:48.910 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:34:48.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:34:48.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:34:48.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:34:48.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:34:48.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:34:48.911 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:34:48.911 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:34:48.911 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:34:48.911 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:34:48.911 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:34:48.911 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:34:48.911 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:34:48.911 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-17T08:34:48.911 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:34:48.912 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=69f59cfe-ee39-4d3c-a5ed-160ac222ae13 2026-02-17T08:34:48.912 INFO:tasks.workunit.client.0.trial059.stdout:add osd1 69f59cfe-ee39-4d3c-a5ed-160ac222ae13 2026-02-17T08:34:48.913 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 69f59cfe-ee39-4d3c-a5ed-160ac222ae13' 2026-02-17T08:34:48.913 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:34:48.922 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAoKJRptFFENhAA4JPf7FhW5kiRM3KpWw3XVw== 2026-02-17T08:34:48.922 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAoKJRptFFENhAA4JPf7FhW5kiRM3KpWw3XVw=="}' 2026-02-17T08:34:48.922 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 69f59cfe-ee39-4d3c-a5ed-160ac222ae13 -i td/test-erasure-eio/1/new.json 2026-02-17T08:34:49.128 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:34:49.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-17T08:34:49.138 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAoKJRptFFENhAA4JPf7FhW5kiRM3KpWw3XVw== --osd-uuid 69f59cfe-ee39-4d3c-a5ed-160ac222ae13 2026-02-17T08:34:49.154 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:49.139+0000 7f17593fd8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:49.155 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:49.139+0000 7f17593fd8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:49.156 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:49.143+0000 7f17593fd8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:49.157 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:49.143+0000 7f17593fd8c0 -1 bdev(0x560282339c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-17T08:34:49.157 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:49.143+0000 7f17593fd8c0 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-17T08:34:51.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-17T08:34:51.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:34:51.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T08:34:51.479 INFO:tasks.workunit.client.0.trial059.stdout:adding osd1 key to auth repository 2026-02-17T08:34:51.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:34:51.755 INFO:tasks.workunit.client.0.trial059.stdout:start osd.1 2026-02-17T08:34:51.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T08:34:51.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:34:51.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:34:51.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:34:51.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:34:51.778 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:51.763+0000 7f2afb8118c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:51.780 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:51.763+0000 7f2afb8118c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:51.781 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:51.767+0000 7f2afb8118c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:51.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T08:34:51.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:34:51.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:34:51.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:34:51.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:34:51.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:51.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:34:51.951 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:34:51.952 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:51.952 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:34:52.151 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:34:53.152 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:34:53.152 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:53.153 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:34:53.153 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:34:53.153 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:53.153 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:34:53.270 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:53.255+0000 7f2afb8118c0 -1 Falling back to public interface 2026-02-17T08:34:53.349 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:34:54.351 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:34:54.351 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:54.351 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:34:54.352 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:34:54.352 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:54.352 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:34:54.548 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:34:55.549 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:34:55.549 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:55.550 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:34:55.550 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:34:55.550 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:55.550 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:34:55.747 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:34:56.280 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:56.263+0000 7f2afb8118c0 -1 osd.1 0 log_to_monitors true 2026-02-17T08:34:56.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:34:56.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:56.749 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:34:56.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:34:56.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:56.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:34:56.948 INFO:tasks.workunit.client.0.trial059.stdout:osd.1 up in weight 1 up_from 12 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2107111319,v1:127.0.0.1:6811/2107111319] [v2:127.0.0.1:6812/2107111319,v1:127.0.0.1:6813/2107111319] exists,up 69f59cfe-ee39-4d3c-a5ed-160ac222ae13 2026-02-17T08:34:56.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:34:56.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:34:56.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:34:56.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:34:56.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-17T08:34:56.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:34:56.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:34:56.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T08:34:56.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:34:56.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-17T08:34:56.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:34:56.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:34:56.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:34:56.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:34:56.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-17T08:34:56.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-17T08:34:56.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:34:56.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:34:56.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:34:56.949 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:34:56.949 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:34:56.949 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:34:56.949 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:34:56.949 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:34:56.949 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:34:56.950 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:34:56.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:34:56.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:34:56.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:34:56.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:34:56.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:34:56.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:34:56.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:34:56.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:34:56.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:34:56.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:34:56.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:34:56.950 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:34:56.951 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-17T08:34:56.952 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:34:56.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=b8a6f4d8-9f55-4bc0-8ce4-52d77b654c33 2026-02-17T08:34:56.953 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 b8a6f4d8-9f55-4bc0-8ce4-52d77b654c33' 2026-02-17T08:34:56.953 INFO:tasks.workunit.client.0.trial059.stdout:add osd2 b8a6f4d8-9f55-4bc0-8ce4-52d77b654c33 2026-02-17T08:34:56.953 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:34:56.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAwKJRpkI7rOBAAiUo7Q5+bjKFRIDFVDrw6og== 2026-02-17T08:34:56.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAwKJRpkI7rOBAAiUo7Q5+bjKFRIDFVDrw6og=="}' 2026-02-17T08:34:56.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new b8a6f4d8-9f55-4bc0-8ce4-52d77b654c33 -i td/test-erasure-eio/2/new.json 2026-02-17T08:34:57.163 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:34:57.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-17T08:34:57.173 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAwKJRpkI7rOBAAiUo7Q5+bjKFRIDFVDrw6og== --osd-uuid b8a6f4d8-9f55-4bc0-8ce4-52d77b654c33 2026-02-17T08:34:57.198 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:57.183+0000 7fbe37d5c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:57.199 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:57.183+0000 7fbe37d5c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:57.200 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:57.183+0000 7fbe37d5c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:57.201 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:57.187+0000 7fbe37d5c8c0 -1 bdev(0x55aa36f59c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-17T08:34:57.201 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:57.187+0000 7fbe37d5c8c0 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-17T08:34:59.490 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-17T08:34:59.491 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:34:59.491 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T08:34:59.491 INFO:tasks.workunit.client.0.trial059.stdout:adding osd2 key to auth repository 2026-02-17T08:34:59.492 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:34:59.778 INFO:tasks.workunit.client.0.trial059.stdout:start osd.2 2026-02-17T08:34:59.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T08:34:59.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:34:59.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:34:59.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:34:59.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:34:59.801 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:59.787+0000 7f83f19da8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:59.803 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:59.787+0000 7f83f19da8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:59.804 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:34:59.787+0000 7f83f19da8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:34:59.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T08:34:59.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:34:59.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:34:59.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:34:59.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:34:59.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:34:59.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:34:59.976 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:34:59.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:34:59.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:35:00.205 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:01.206 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:01.207 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:01.207 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:35:01.207 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:35:01.207 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:01.207 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:35:01.366 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:01.351+0000 7f83f19da8c0 -1 Falling back to public interface 2026-02-17T08:35:01.404 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:02.406 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:02.406 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:02.406 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:35:02.407 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:35:02.407 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:02.407 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:35:02.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:03.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:03.609 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:03.610 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:35:03.610 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:35:03.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:03.611 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:35:03.809 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:04.316 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:04.299+0000 7f83f19da8c0 -1 osd.2 0 log_to_monitors true 2026-02-17T08:35:04.810 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:04.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:04.811 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:35:04.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:35:04.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:04.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:35:05.011 INFO:tasks.workunit.client.0.trial059.stdout:osd.2 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3413938605,v1:127.0.0.1:6819/3413938605] [v2:127.0.0.1:6820/3413938605,v1:127.0.0.1:6821/3413938605] exists,up b8a6f4d8-9f55-4bc0-8ce4-52d77b654c33 2026-02-17T08:35:05.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:35:05.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:35:05.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:35:05.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:35:05.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-17T08:35:05.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:35:05.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:35:05.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2026-02-17T08:35:05.015 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:35:05.016 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-17T08:35:05.016 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:35:05.016 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:35:05.016 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:35:05.016 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:35:05.016 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-17T08:35:05.016 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-17T08:35:05.016 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:35:05.016 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:35:05.016 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:35:05.016 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:35:05.016 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:35:05.016 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:35:05.017 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:35:05.017 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:35:05.017 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:35:05.017 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:35:05.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:35:05.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:35:05.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:35:05.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:35:05.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:35:05.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:35:05.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:35:05.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:35:05.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:35:05.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:35:05.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:35:05.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:35:05.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-17T08:35:05.018 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:35:05.019 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=0357bd26-5838-4074-a08e-09817d7915a6 2026-02-17T08:35:05.019 INFO:tasks.workunit.client.0.trial059.stdout:add osd3 0357bd26-5838-4074-a08e-09817d7915a6 2026-02-17T08:35:05.019 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 0357bd26-5838-4074-a08e-09817d7915a6' 2026-02-17T08:35:05.019 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:35:05.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQA5KJRpN/n5ABAAApFfo3So9wM34SPfYpjSBA== 2026-02-17T08:35:05.028 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQA5KJRpN/n5ABAAApFfo3So9wM34SPfYpjSBA=="}' 2026-02-17T08:35:05.028 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 0357bd26-5838-4074-a08e-09817d7915a6 -i td/test-erasure-eio/3/new.json 2026-02-17T08:35:05.236 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:35:05.245 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-17T08:35:05.246 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA5KJRpN/n5ABAAApFfo3So9wM34SPfYpjSBA== --osd-uuid 0357bd26-5838-4074-a08e-09817d7915a6 2026-02-17T08:35:05.262 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:05.247+0000 7f277cb1a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:05.263 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:05.247+0000 7f277cb1a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:05.265 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:05.251+0000 7f277cb1a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:05.265 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:05.251+0000 7f277cb1a8c0 -1 bdev(0x55acfc7cbc00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-17T08:35:05.265 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:05.251+0000 7f277cb1a8c0 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-17T08:35:07.526 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-17T08:35:07.526 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:35:07.527 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2026-02-17T08:35:07.527 INFO:tasks.workunit.client.0.trial059.stdout:adding osd3 key to auth repository 2026-02-17T08:35:07.527 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:35:07.799 INFO:tasks.workunit.client.0.trial059.stdout:start osd.3 2026-02-17T08:35:07.800 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2026-02-17T08:35:07.800 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:35:07.800 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:35:07.800 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:35:07.800 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:35:07.823 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:07.807+0000 7f1d80f928c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:07.824 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:07.811+0000 7f1d80f928c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:07.825 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:07.811+0000 7f1d80f928c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:07.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2026-02-17T08:35:07.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:35:07.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T08:35:07.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:35:07.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:35:07.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:07.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:35:07.994 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:35:07.994 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:07.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:35:08.196 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:09.197 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:09.198 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:09.198 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:35:09.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:35:09.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:09.199 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:35:09.326 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:09.311+0000 7f1d80f928c0 -1 Falling back to public interface 2026-02-17T08:35:09.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:10.404 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:10.404 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:10.404 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:35:10.404 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:35:10.404 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:10.404 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:35:10.601 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:11.602 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:11.603 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:11.603 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:35:11.603 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:35:11.604 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:11.604 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:35:11.800 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:12.331 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:12.315+0000 7f1d80f928c0 -1 osd.3 0 log_to_monitors true 2026-02-17T08:35:12.801 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:12.801 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:12.802 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:35:12.802 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:35:12.802 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:12.803 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:35:13.005 INFO:tasks.workunit.client.0.trial059.stdout:osd.3 up in weight 1 up_from 26 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1416375382,v1:127.0.0.1:6827/1416375382] [v2:127.0.0.1:6828/1416375382,v1:127.0.0.1:6829/1416375382] exists,up 0357bd26-5838-4074-a08e-09817d7915a6 2026-02-17T08:35:13.005 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:35:13.005 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:35:13.005 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:35:13.006 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-17T08:35:13.006 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:35:13.006 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:35:13.006 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:35:13.006 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:35:13.006 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:35:13.007 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.0.asok 2026-02-17T08:35:13.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-17T08:35:13.008 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.0.asok log flush 2026-02-17T08:35:13.071 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:35:13.077 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-17T08:35:13.079 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:34:45.251+0000 7f1390be58c0 0 load: jerasure load: lrc 2026-02-17T08:35:13.079 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:258: TEST_rados_get_subread_eio_shard_0: local poolname=pool-jerasure 2026-02-17T08:35:13.079 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:259: TEST_rados_get_subread_eio_shard_0: create_erasure_coded_pool pool-jerasure 2 1 2026-02-17T08:35:13.079 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:35:13.079 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-17T08:35:13.079 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=2 2026-02-17T08:35:13.079 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-17T08:35:13.080 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=1 2026-02-17T08:35:13.080 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-17T08:35:13.080 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=2 m=1 crush-failure-domain=osd 2026-02-17T08:35:13.331 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-17T08:35:13.331 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-17T08:35:13.728 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' already exists 2026-02-17T08:35:13.737 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:35:14.738 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-17T08:35:14.739 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:35:14.739 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:35:14.739 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:35:14.739 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:35:14.740 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:35:14.740 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:35:14.741 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:35:14.741 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:35:14.741 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:35:14.857 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:35:14.857 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:35:14.857 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:35:14.857 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:35:14.858 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:35:14.858 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:35:15.059 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:35:15.059 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:35:15.059 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:35:15.059 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:35:15.059 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:35:15.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:35:15.060 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:35:15.135 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803784 2026-02-17T08:35:15.135 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803784 2026-02-17T08:35:15.135 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803784' 2026-02-17T08:35:15.135 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:35:15.135 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:35:15.210 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=51539607558 2026-02-17T08:35:15.210 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 51539607558 2026-02-17T08:35:15.210 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803784 1-51539607558' 2026-02-17T08:35:15.211 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:35:15.211 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:35:15.286 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411332 2026-02-17T08:35:15.286 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411332 2026-02-17T08:35:15.286 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803784 1-51539607558 2-77309411332' 2026-02-17T08:35:15.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:35:15.287 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:35:15.362 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=111669149699 2026-02-17T08:35:15.362 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 111669149699 2026-02-17T08:35:15.362 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803784 1-51539607558 2-77309411332 3-111669149699' 2026-02-17T08:35:15.362 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:35:15.363 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803784 2026-02-17T08:35:15.363 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:35:15.364 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:35:15.364 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803784 2026-02-17T08:35:15.365 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:35:15.366 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803784 2026-02-17T08:35:15.366 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 25769803784 2026-02-17T08:35:15.367 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803784' 2026-02-17T08:35:15.367 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:35:15.563 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803781 -lt 25769803784 2026-02-17T08:35:15.563 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:35:16.564 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:35:16.565 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:35:16.763 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803784 -lt 25769803784 2026-02-17T08:35:16.763 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:35:16.764 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-51539607558 2026-02-17T08:35:16.765 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:35:16.765 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:35:16.766 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-51539607558 2026-02-17T08:35:16.766 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:35:16.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=51539607558 2026-02-17T08:35:16.768 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 51539607558 2026-02-17T08:35:16.768 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 51539607558' 2026-02-17T08:35:16.768 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:35:16.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 51539607558 -lt 51539607558 2026-02-17T08:35:16.978 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:35:16.978 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-77309411332 2026-02-17T08:35:16.978 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:35:16.979 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:35:16.980 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-77309411332 2026-02-17T08:35:16.980 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:35:16.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411332 2026-02-17T08:35:16.982 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 77309411332 2026-02-17T08:35:16.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 77309411332' 2026-02-17T08:35:16.982 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:35:17.188 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411333 -lt 77309411332 2026-02-17T08:35:17.188 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:35:17.188 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-111669149699 2026-02-17T08:35:17.189 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:35:17.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:35:17.191 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-111669149699 2026-02-17T08:35:17.191 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:35:17.192 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=111669149699 2026-02-17T08:35:17.192 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 111669149699' 2026-02-17T08:35:17.193 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 111669149699 2026-02-17T08:35:17.193 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:35:17.396 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 111669149699 -lt 111669149699 2026-02-17T08:35:17.396 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:35:17.397 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:35:17.397 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:35:17.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:35:17.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:35:17.658 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:35:17.658 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:35:17.658 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:35:17.658 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:35:17.658 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:35:17.658 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:35:17.854 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:35:17.854 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:35:17.855 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:35:17.855 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:35:18.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:35:18.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:35:18.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:35:18.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:261: TEST_rados_get_subread_eio_shard_0: local shard_id=0 2026-02-17T08:35:18.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:262: TEST_rados_get_subread_eio_shard_0: rados_put_get_data eio td/test-erasure-eio 0 2026-02-17T08:35:18.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:147: rados_put_get_data: local inject=eio 2026-02-17T08:35:18.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:148: rados_put_get_data: shift 2026-02-17T08:35:18.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:149: rados_put_get_data: local dir=td/test-erasure-eio 2026-02-17T08:35:18.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:150: rados_put_get_data: shift 2026-02-17T08:35:18.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:151: rados_put_get_data: local shard_id=0 2026-02-17T08:35:18.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:152: rados_put_get_data: shift 2026-02-17T08:35:18.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:153: rados_put_get_data: local arg= 2026-02-17T08:35:18.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:157: rados_put_get_data: local poolname=pool-jerasure 2026-02-17T08:35:18.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:158: rados_put_get_data: local objname=obj-eio-70936-0 2026-02-17T08:35:18.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:159: rados_put_get_data: rados_put td/test-erasure-eio pool-jerasure obj-eio-70936-0 2026-02-17T08:35:18.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-17T08:35:18.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-17T08:35:18.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-eio-70936-0 2026-02-17T08:35:18.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:35:18.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-17T08:35:18.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:35:18.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-17T08:35:18.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:35:18.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-17T08:35:18.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:35:18.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-17T08:35:18.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-eio-70936-0 td/test-erasure-eio/ORIGINAL 2026-02-17T08:35:18.131 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:160: rados_put_get_data: inject_eio ec data pool-jerasure obj-eio-70936-0 td/test-erasure-eio 0 2026-02-17T08:35:18.131 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2457: inject_eio: local pooltype=ec 2026-02-17T08:35:18.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2458: inject_eio: shift 2026-02-17T08:35:18.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2459: inject_eio: local which=data 2026-02-17T08:35:18.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2460: inject_eio: shift 2026-02-17T08:35:18.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2461: inject_eio: local poolname=pool-jerasure 2026-02-17T08:35:18.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2462: inject_eio: shift 2026-02-17T08:35:18.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2463: inject_eio: local objname=obj-eio-70936-0 2026-02-17T08:35:18.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2464: inject_eio: shift 2026-02-17T08:35:18.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2465: inject_eio: local dir=td/test-erasure-eio 2026-02-17T08:35:18.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2466: inject_eio: shift 2026-02-17T08:35:18.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2467: inject_eio: local shard_id=0 2026-02-17T08:35:18.133 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2468: inject_eio: shift 2026-02-17T08:35:18.133 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: get_osds pool-jerasure obj-eio-70936-0 2026-02-17T08:35:18.133 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:35:18.133 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj-eio-70936-0 2026-02-17T08:35:18.133 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj-eio-70936-0 2026-02-17T08:35:18.133 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:35:18.334 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:35:18.334 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:35:18.334 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:35:18.334 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 2 2026-02-17T08:35:18.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: initial_osds=('3' '1' '2') 2026-02-17T08:35:18.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: local -a initial_osds 2026-02-17T08:35:18.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2471: inject_eio: local osd_id=3 2026-02-17T08:35:18.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2472: inject_eio: '[' ec '!=' ec ']' 2026-02-17T08:35:18.335 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: cat td/test-erasure-eio/3/type 2026-02-17T08:35:18.336 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: type=bluestore 2026-02-17T08:35:18.337 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2476: inject_eio: set_config osd 3 bluestore_debug_inject_read_err true 2026-02-17T08:35:18.337 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1161: set_config: local daemon=osd 2026-02-17T08:35:18.337 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1162: set_config: local id=3 2026-02-17T08:35:18.337 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1163: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T08:35:18.337 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1164: set_config: local value=true 2026-02-17T08:35:18.337 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: jq 'has("success")' 2026-02-17T08:35:18.337 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: get_asok_path osd.3 2026-02-17T08:35:18.337 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2026-02-17T08:35:18.337 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2026-02-17T08:35:18.337 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:35:18.337 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:35:18.337 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:35:18.338 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.3.asok 2026-02-17T08:35:18.338 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.70936/ceph-osd.3.asok config set bluestore_debug_inject_read_err true 2026-02-17T08:35:18.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: test true == true 2026-02-17T08:35:18.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2477: inject_eio: local loop=0 2026-02-17T08:35:18.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2479: inject_eio: grep -q Invalid 2026-02-17T08:35:18.397 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: get_asok_path osd.3 2026-02-17T08:35:18.398 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2026-02-17T08:35:18.398 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2026-02-17T08:35:18.398 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:35:18.398 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:35:18.398 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:35:18.398 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.3.asok 2026-02-17T08:35:18.399 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: CEPH_ARGS= 2026-02-17T08:35:18.399 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.3.asok injectdataerr pool-jerasure obj-eio-70936-0 0 2026-02-17T08:35:18.457 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:161: rados_put_get_data: rados_get td/test-erasure-eio pool-jerasure obj-eio-70936-0 2026-02-17T08:35:18.458 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:35:18.458 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:35:18.458 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-eio-70936-0 2026-02-17T08:35:18.458 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-17T08:35:18.458 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-17T08:35:18.458 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-eio-70936-0 td/test-erasure-eio/COPY 2026-02-17T08:35:18.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-17T08:35:18.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-17T08:35:18.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:163: rados_put_get_data: '[' '' = recovery ']' 2026-02-17T08:35:18.479 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:181: rados_put_get_data: expr 0 + 1 2026-02-17T08:35:18.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:181: rados_put_get_data: shard_id=1 2026-02-17T08:35:18.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:182: rados_put_get_data: inject_eio ec data pool-jerasure obj-eio-70936-0 td/test-erasure-eio 1 2026-02-17T08:35:18.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2457: inject_eio: local pooltype=ec 2026-02-17T08:35:18.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2458: inject_eio: shift 2026-02-17T08:35:18.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2459: inject_eio: local which=data 2026-02-17T08:35:18.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2460: inject_eio: shift 2026-02-17T08:35:18.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2461: inject_eio: local poolname=pool-jerasure 2026-02-17T08:35:18.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2462: inject_eio: shift 2026-02-17T08:35:18.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2463: inject_eio: local objname=obj-eio-70936-0 2026-02-17T08:35:18.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2464: inject_eio: shift 2026-02-17T08:35:18.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2465: inject_eio: local dir=td/test-erasure-eio 2026-02-17T08:35:18.483 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2466: inject_eio: shift 2026-02-17T08:35:18.483 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2467: inject_eio: local shard_id=1 2026-02-17T08:35:18.483 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2468: inject_eio: shift 2026-02-17T08:35:18.483 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: get_osds pool-jerasure obj-eio-70936-0 2026-02-17T08:35:18.483 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:35:18.483 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj-eio-70936-0 2026-02-17T08:35:18.483 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj-eio-70936-0 2026-02-17T08:35:18.484 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:35:18.678 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:35:18.678 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:35:18.679 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:35:18.679 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 2 2026-02-17T08:35:18.679 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: initial_osds=('3' '1' '2') 2026-02-17T08:35:18.679 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: local -a initial_osds 2026-02-17T08:35:18.679 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2471: inject_eio: local osd_id=1 2026-02-17T08:35:18.679 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2472: inject_eio: '[' ec '!=' ec ']' 2026-02-17T08:35:18.679 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: cat td/test-erasure-eio/1/type 2026-02-17T08:35:18.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: type=bluestore 2026-02-17T08:35:18.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2476: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-17T08:35:18.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1161: set_config: local daemon=osd 2026-02-17T08:35:18.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1162: set_config: local id=1 2026-02-17T08:35:18.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1163: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T08:35:18.682 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1164: set_config: local value=true 2026-02-17T08:35:18.682 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: jq 'has("success")' 2026-02-17T08:35:18.682 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: get_asok_path osd.1 2026-02-17T08:35:18.682 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2026-02-17T08:35:18.682 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2026-02-17T08:35:18.683 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:35:18.683 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:35:18.683 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:35:18.683 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.1.asok 2026-02-17T08:35:18.683 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.70936/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-17T08:35:18.751 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: test true == true 2026-02-17T08:35:18.751 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2477: inject_eio: local loop=0 2026-02-17T08:35:18.752 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2479: inject_eio: grep -q Invalid 2026-02-17T08:35:18.752 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: get_asok_path osd.1 2026-02-17T08:35:18.752 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2026-02-17T08:35:18.753 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2026-02-17T08:35:18.754 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:35:18.754 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:35:18.754 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:35:18.754 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.1.asok 2026-02-17T08:35:18.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: CEPH_ARGS= 2026-02-17T08:35:18.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.1.asok injectdataerr pool-jerasure obj-eio-70936-0 1 2026-02-17T08:35:18.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:183: rados_put_get_data: rados_get td/test-erasure-eio pool-jerasure obj-eio-70936-0 fail 2026-02-17T08:35:18.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:35:18.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:35:18.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-eio-70936-0 2026-02-17T08:35:18.812 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=fail 2026-02-17T08:35:18.812 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' fail = fail ']' 2026-02-17T08:35:18.812 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:114: rados_get: rados --pool pool-jerasure get obj-eio-70936-0 td/test-erasure-eio/COPY 2026-02-17T08:35:18.828 INFO:tasks.workunit.client.0.trial059.stderr:error getting pool-jerasure/obj-eio-70936-0: (5) Input/output error 2026-02-17T08:35:18.830 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:115: rados_get: return 2026-02-17T08:35:18.830 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:184: rados_put_get_data: rm td/test-erasure-eio/ORIGINAL 2026-02-17T08:35:18.831 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:263: TEST_rados_get_subread_eio_shard_0: delete_erasure_coded_pool pool-jerasure 2026-02-17T08:35:18.831 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:35:18.831 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-17T08:35:19.074 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' does not exist 2026-02-17T08:35:19.083 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-17T08:35:19.341 INFO:tasks.workunit.client.0.trial059.stderr:erasure-code-profile myprofile does not exist 2026-02-17T08:35:19.350 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-17T08:35:19.351 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:35:19.351 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:35:19.351 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:35:19.351 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:35:19.351 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:35:19.352 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:35:19.352 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:35:19.352 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:35:19.663 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:35:19.664 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:35:19.665 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:35:19.665 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:35:19.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:35:19.667 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:35:19.668 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:35:19.669 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:35:19.669 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:35:19.669 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:35:19.670 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:35:19.671 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:35:19.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:35:19.672 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:35:19.682 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:35:19.682 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:35:19.682 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:35:19.682 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:35:19.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:35:19.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:35:19.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-17T08:35:19.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-17T08:35:19.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-eio 2026-02-17T08:35:19.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-eio 2026-02-17T08:35:19.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:35:19.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:35:19.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:35:19.684 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:35:19.684 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:35:19.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:35:19.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:35:19.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:35:19.688 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:35:19.688 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:35:19.688 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:35:19.689 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:35:19.690 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:35:19.690 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:35:19.690 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:35:19.691 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:35:19.691 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:35:19.692 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:35:19.692 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:35:19.693 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:35:19.694 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:35:19.694 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:35:19.695 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:35:19.695 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:35:19.696 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:35:19.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:35:19.697 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:35:19.697 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:35:19.697 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-eio 2026-02-17T08:35:19.698 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:35:19.698 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:35:19.698 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:35:19.698 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.70936 2026-02-17T08:35:19.700 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:35:19.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:35:19.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:35:19.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-17T08:35:19.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-17T08:35:19.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-eio 2026-02-17T08:35:19.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:35:19.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:35:19.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:35:19.701 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-eio/a 2026-02-17T08:35:19.701 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-17T08:35:19.722 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:35:19.722 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:35:19.722 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:35:19.723 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:35:19.723 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:35:19.723 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:35:19.723 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:35:19.723 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T08:35:19.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:35:19.754 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:35:19.754 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:35:19.754 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:35:19.754 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:35:19.755 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:35:19.756 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:35:19.756 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:35:19.756 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:35:19.756 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:35:19.756 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:35:19.756 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:35:19.756 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:35:19.756 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:35:19.757 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get fsid 2026-02-17T08:35:19.811 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:35:19.811 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:35:19.811 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:35:19.811 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:35:19.811 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:35:19.811 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:35:19.812 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:35:19.812 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:35:19.812 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:35:19.812 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:35:19.812 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:35:19.812 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:35:19.813 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:35:19.813 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get mon_host 2026-02-17T08:35:19.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-17T08:35:19.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-eio 2026-02-17T08:35:19.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:35:19.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:35:19.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:35:19.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-eio/x 2026-02-17T08:35:19.868 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:35:19.976 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:35:19.976 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:35:19.976 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:35:19.976 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:35:19.976 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:35:19.976 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:35:19.977 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:35:19.977 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:35:19.978 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:35:19.996 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-17T08:35:19.996 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T08:35:20.103 INFO:tasks.workunit.client.0.trial059.stderr:pool 'rbd' already exists 2026-02-17T08:35:20.111 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:35:21.114 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-17T08:35:21.114 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:35:21.114 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:35:21.115 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:35:21.115 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:35:21.115 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:35:21.115 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:35:21.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-17T08:35:21.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-mon.a.asok log flush 2026-02-17T08:35:21.163 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:35:21.169 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-17T08:35:21.171 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:35:19.728+0000 7f48ab643ec0 0 load: jerasure load: lrc 2026-02-17T08:35:21.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_rados_get_subread_eio_shard_1 td/test-erasure-eio 2026-02-17T08:35:21.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:267: TEST_rados_get_subread_eio_shard_1: local dir=td/test-erasure-eio 2026-02-17T08:35:21.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:268: TEST_rados_get_subread_eio_shard_1: setup_osds 4 2026-02-17T08:35:21.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=4 2026-02-17T08:35:21.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-17T08:35:21.173 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 4 - 1 2026-02-17T08:35:21.173 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 3 2026-02-17T08:35:21.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:35:21.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-17T08:35:21.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:35:21.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:35:21.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:35:21.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:35:21.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-17T08:35:21.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:35:21.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:35:21.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:35:21.177 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:35:21.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-17T08:35:21.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-17T08:35:21.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:35:21.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:35:21.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:35:21.178 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:35:21.178 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:35:21.178 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:35:21.178 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:35:21.178 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:35:21.178 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:35:21.178 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:35:21.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:35:21.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:35:21.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:35:21.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:35:21.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:35:21.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:35:21.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:35:21.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:35:21.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:35:21.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:35:21.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:35:21.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:35:21.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-17T08:35:21.180 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:35:21.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=c8e3a9a6-52e5-43ee-803e-3598d458c75c 2026-02-17T08:35:21.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 c8e3a9a6-52e5-43ee-803e-3598d458c75c' 2026-02-17T08:35:21.181 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 c8e3a9a6-52e5-43ee-803e-3598d458c75c 2026-02-17T08:35:21.181 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:35:21.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBJKJRpTOenChAA4h92EnWHRkWEptc4LQUAaA== 2026-02-17T08:35:21.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBJKJRpTOenChAA4h92EnWHRkWEptc4LQUAaA=="}' 2026-02-17T08:35:21.190 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new c8e3a9a6-52e5-43ee-803e-3598d458c75c -i td/test-erasure-eio/0/new.json 2026-02-17T08:35:21.298 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:35:21.305 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-17T08:35:21.307 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBJKJRpTOenChAA4h92EnWHRkWEptc4LQUAaA== --osd-uuid c8e3a9a6-52e5-43ee-803e-3598d458c75c 2026-02-17T08:35:21.322 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:21.308+0000 7f4acf4fb8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:21.323 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:21.308+0000 7f4acf4fb8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:21.324 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:21.312+0000 7f4acf4fb8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:21.325 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:21.312+0000 7f4acf4fb8c0 -1 bdev(0x55cbf9d2dc00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:35:21.325 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:21.312+0000 7f4acf4fb8c0 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-17T08:35:23.864 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-17T08:35:23.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:35:23.866 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:35:23.866 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:35:23.867 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:35:24.140 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:35:24.141 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:35:24.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:35:24.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:35:24.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:35:24.142 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:35:24.163 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:24.148+0000 7f23d19e38c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:24.164 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:24.152+0000 7f23d19e38c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:24.165 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:24.152+0000 7f23d19e38c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:24.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:35:24.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:35:24.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:35:24.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:35:24.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:35:24.340 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:24.340 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:35:24.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:35:24.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:24.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:35:24.536 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:25.538 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:25.538 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:25.539 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:35:25.539 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:35:25.539 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:25.539 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:35:25.662 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:25.648+0000 7f23d19e38c0 -1 Falling back to public interface 2026-02-17T08:35:25.738 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:26.739 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:26.739 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:26.739 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:35:26.739 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:35:26.739 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:26.739 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:35:26.937 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:27.939 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:27.939 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:27.939 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:35:27.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:35:27.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:27.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:35:28.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:28.713 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:28.700+0000 7f23d19e38c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:35:29.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:29.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:29.137 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:35:29.138 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:35:29.138 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:29.138 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:35:29.335 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 6 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2358993348,v1:127.0.0.1:6803/2358993348] [v2:127.0.0.1:6804/2358993348,v1:127.0.0.1:6805/2358993348] exists,up c8e3a9a6-52e5-43ee-803e-3598d458c75c 2026-02-17T08:35:29.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:35:29.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:35:29.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:35:29.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:35:29.338 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-17T08:35:29.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:35:29.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:35:29.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T08:35:29.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:35:29.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-17T08:35:29.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:35:29.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:35:29.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:35:29.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:35:29.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-17T08:35:29.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-17T08:35:29.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:35:29.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:35:29.340 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:35:29.340 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:35:29.340 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:35:29.340 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:35:29.340 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:35:29.340 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:35:29.340 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:35:29.340 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:35:29.340 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:35:29.340 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:35:29.340 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:35:29.340 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:35:29.340 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:35:29.340 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:35:29.340 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:35:29.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:35:29.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:35:29.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:35:29.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:35:29.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:35:29.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-17T08:35:29.341 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:35:29.342 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=14d15bc5-8d25-429c-a246-141eaeddbce6 2026-02-17T08:35:29.342 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 14d15bc5-8d25-429c-a246-141eaeddbce6' 2026-02-17T08:35:29.342 INFO:tasks.workunit.client.0.trial059.stdout:add osd1 14d15bc5-8d25-429c-a246-141eaeddbce6 2026-02-17T08:35:29.342 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:35:29.352 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBRKJRpdQxMFBAAVJH13H2HocGoXg5m1o4dRQ== 2026-02-17T08:35:29.352 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBRKJRpdQxMFBAAVJH13H2HocGoXg5m1o4dRQ=="}' 2026-02-17T08:35:29.353 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 14d15bc5-8d25-429c-a246-141eaeddbce6 -i td/test-erasure-eio/1/new.json 2026-02-17T08:35:29.562 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:35:29.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-17T08:35:29.573 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBRKJRpdQxMFBAAVJH13H2HocGoXg5m1o4dRQ== --osd-uuid 14d15bc5-8d25-429c-a246-141eaeddbce6 2026-02-17T08:35:29.589 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:29.576+0000 7f7ffa5b08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:29.590 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:29.576+0000 7f7ffa5b08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:29.591 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:29.576+0000 7f7ffa5b08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:29.592 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:29.576+0000 7f7ffa5b08c0 -1 bdev(0x55d0970c9c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-17T08:35:29.592 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:29.580+0000 7f7ffa5b08c0 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-17T08:35:31.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-17T08:35:31.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:35:31.850 INFO:tasks.workunit.client.0.trial059.stdout:adding osd1 key to auth repository 2026-02-17T08:35:31.850 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T08:35:31.851 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:35:32.120 INFO:tasks.workunit.client.0.trial059.stdout:start osd.1 2026-02-17T08:35:32.121 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T08:35:32.121 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:35:32.121 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:35:32.121 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:35:32.121 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:35:32.144 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:32.128+0000 7ff84c6ff8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:32.145 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:32.132+0000 7ff84c6ff8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:32.147 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:32.132+0000 7ff84c6ff8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:32.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T08:35:32.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:35:32.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:35:32.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:35:32.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:35:32.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:32.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:35:32.321 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:35:32.321 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:32.322 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:35:32.520 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:33.521 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:33.521 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:33.522 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:35:33.522 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:35:33.523 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:33.523 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:35:33.658 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:33.644+0000 7ff84c6ff8c0 -1 Falling back to public interface 2026-02-17T08:35:33.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:34.721 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:34.721 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:34.721 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:35:34.722 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:35:34.722 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:34.722 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:35:34.921 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:35.923 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:35.923 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:35.923 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:35:35.924 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:35:35.924 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:35.924 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:35:36.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:36.915 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:36.900+0000 7ff84c6ff8c0 -1 osd.1 0 log_to_monitors true 2026-02-17T08:35:37.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:37.124 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:37.125 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:35:37.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:35:37.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:37.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:35:37.328 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:38.329 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:38.330 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:38.330 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:35:38.331 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:35:38.331 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:38.331 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:35:38.527 INFO:tasks.workunit.client.0.trial059.stdout:osd.1 up in weight 1 up_from 13 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1075955621,v1:127.0.0.1:6811/1075955621] [v2:127.0.0.1:6812/1075955621,v1:127.0.0.1:6813/1075955621] exists,up 14d15bc5-8d25-429c-a246-141eaeddbce6 2026-02-17T08:35:38.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:35:38.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:35:38.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:35:38.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:35:38.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-17T08:35:38.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:35:38.531 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:35:38.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T08:35:38.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:35:38.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-17T08:35:38.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:35:38.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:35:38.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:35:38.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:35:38.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-17T08:35:38.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-17T08:35:38.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:35:38.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:35:38.533 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:35:38.533 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:35:38.533 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:35:38.533 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:35:38.533 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:35:38.533 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:35:38.533 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:35:38.533 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:35:38.533 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:35:38.533 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:35:38.533 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:35:38.533 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:35:38.534 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:35:38.534 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:35:38.534 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:35:38.534 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:35:38.534 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:35:38.534 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:35:38.534 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:35:38.534 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:35:38.534 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-17T08:35:38.535 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:35:38.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=323c3374-bf42-4897-8107-9b54513d715d 2026-02-17T08:35:38.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 323c3374-bf42-4897-8107-9b54513d715d' 2026-02-17T08:35:38.536 INFO:tasks.workunit.client.0.trial059.stdout:add osd2 323c3374-bf42-4897-8107-9b54513d715d 2026-02-17T08:35:38.536 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:35:38.544 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBaKJRpoUy9HxAAI5UA9LUnRXDqkMdDs/Djpg== 2026-02-17T08:35:38.544 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBaKJRpoUy9HxAAI5UA9LUnRXDqkMdDs/Djpg=="}' 2026-02-17T08:35:38.544 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 323c3374-bf42-4897-8107-9b54513d715d -i td/test-erasure-eio/2/new.json 2026-02-17T08:35:38.747 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:35:38.756 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-17T08:35:38.757 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBaKJRpoUy9HxAAI5UA9LUnRXDqkMdDs/Djpg== --osd-uuid 323c3374-bf42-4897-8107-9b54513d715d 2026-02-17T08:35:38.773 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:38.760+0000 7f98e58328c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:38.775 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:38.760+0000 7f98e58328c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:38.776 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:38.764+0000 7f98e58328c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:38.777 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:38.764+0000 7f98e58328c0 -1 bdev(0x55fba420fc00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-17T08:35:38.777 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:38.764+0000 7f98e58328c0 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-17T08:35:41.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-17T08:35:41.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:35:41.066 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T08:35:41.067 INFO:tasks.workunit.client.0.trial059.stdout:adding osd2 key to auth repository 2026-02-17T08:35:41.067 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:35:41.340 INFO:tasks.workunit.client.0.trial059.stdout:start osd.2 2026-02-17T08:35:41.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T08:35:41.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:35:41.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:35:41.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:35:41.341 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:35:41.364 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:41.352+0000 7f6fff50b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:41.366 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:41.352+0000 7f6fff50b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:41.367 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:41.352+0000 7f6fff50b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:41.540 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T08:35:41.540 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:35:41.540 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:35:41.540 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:35:41.540 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:35:41.540 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:41.541 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:35:41.541 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:35:41.541 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:41.542 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:35:41.742 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:42.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:42.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:42.744 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:35:42.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:35:42.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:42.745 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:35:42.854 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:42.840+0000 7f6fff50b8c0 -1 Falling back to public interface 2026-02-17T08:35:42.939 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:43.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:43.941 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:43.941 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:35:43.941 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:35:43.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:43.942 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:35:44.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:45.139 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:45.139 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:45.139 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:35:45.139 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:35:45.139 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:45.139 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:35:45.331 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:46.067 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:46.052+0000 7f6fff50b8c0 -1 osd.2 0 log_to_monitors true 2026-02-17T08:35:46.333 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:46.334 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:46.334 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:35:46.335 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:35:46.335 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:46.335 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:35:46.532 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:47.533 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:47.533 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:47.534 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:35:47.534 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:35:47.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:47.535 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:35:47.737 INFO:tasks.workunit.client.0.trial059.stdout:osd.2 up in weight 1 up_from 18 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/413286120,v1:127.0.0.1:6819/413286120] [v2:127.0.0.1:6820/413286120,v1:127.0.0.1:6821/413286120] exists,up 323c3374-bf42-4897-8107-9b54513d715d 2026-02-17T08:35:47.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:35:47.740 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:35:47.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:35:47.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:35:47.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-17T08:35:47.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:35:47.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:35:47.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2026-02-17T08:35:47.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:35:47.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-17T08:35:47.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:35:47.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:35:47.741 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:35:47.742 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:35:47.742 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-17T08:35:47.742 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-17T08:35:47.742 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:35:47.742 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:35:47.742 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:35:47.742 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:35:47.742 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:35:47.742 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:35:47.742 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:35:47.742 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:35:47.742 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:35:47.742 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:35:47.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:35:47.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:35:47.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:35:47.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:35:47.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:35:47.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:35:47.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:35:47.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:35:47.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:35:47.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:35:47.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:35:47.743 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:35:47.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-17T08:35:47.744 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:35:47.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=140388a4-2119-44d1-9b9e-b103065f627e 2026-02-17T08:35:47.745 INFO:tasks.workunit.client.0.trial059.stdout:add osd3 140388a4-2119-44d1-9b9e-b103065f627e 2026-02-17T08:35:47.745 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 140388a4-2119-44d1-9b9e-b103065f627e' 2026-02-17T08:35:47.745 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:35:47.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBjKJRpk99NLBAAyg3ndZVYCcX9vIr0xMJDyg== 2026-02-17T08:35:47.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBjKJRpk99NLBAAyg3ndZVYCcX9vIr0xMJDyg=="}' 2026-02-17T08:35:47.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 140388a4-2119-44d1-9b9e-b103065f627e -i td/test-erasure-eio/3/new.json 2026-02-17T08:35:47.960 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:35:47.969 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-17T08:35:47.970 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBjKJRpk99NLBAAyg3ndZVYCcX9vIr0xMJDyg== --osd-uuid 140388a4-2119-44d1-9b9e-b103065f627e 2026-02-17T08:35:47.985 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:47.972+0000 7efe9cbfb8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:47.986 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:47.972+0000 7efe9cbfb8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:47.988 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:47.972+0000 7efe9cbfb8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:47.988 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:47.976+0000 7efe9cbfb8c0 -1 bdev(0x55693e0d9c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-17T08:35:47.988 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:47.976+0000 7efe9cbfb8c0 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-17T08:35:50.251 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-17T08:35:50.251 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:35:50.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2026-02-17T08:35:50.253 INFO:tasks.workunit.client.0.trial059.stdout:adding osd3 key to auth repository 2026-02-17T08:35:50.253 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:35:50.520 INFO:tasks.workunit.client.0.trial059.stdout:start osd.3 2026-02-17T08:35:50.520 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2026-02-17T08:35:50.520 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:35:50.521 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:35:50.521 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:35:50.521 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:35:50.536 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:50.524+0000 7ff86ed1a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:50.537 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:50.524+0000 7ff86ed1a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:50.538 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:50.524+0000 7ff86ed1a8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:35:50.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2026-02-17T08:35:50.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:35:50.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T08:35:50.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:35:50.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:35:50.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:50.727 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:35:50.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:35:50.727 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:50.728 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:35:50.920 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:51.921 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:51.921 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:51.921 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:35:51.921 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:35:51.921 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:51.921 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:35:52.042 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:52.028+0000 7ff86ed1a8c0 -1 Falling back to public interface 2026-02-17T08:35:52.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:53.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:53.117 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:53.117 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:35:53.118 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:35:53.118 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:53.118 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:35:53.312 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:54.313 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:54.313 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:54.314 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:35:54.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:35:54.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:54.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:35:54.507 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:55.312 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:35:55.300+0000 7ff86ed1a8c0 -1 osd.3 0 log_to_monitors true 2026-02-17T08:35:55.509 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:55.509 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:55.510 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:35:55.510 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:35:55.510 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:55.510 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:35:55.709 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:35:56.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:35:56.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:35:56.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:35:56.710 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:35:56.711 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:35:56.711 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:35:56.906 INFO:tasks.workunit.client.0.trial059.stdout:osd.3 up in weight 1 up_from 26 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1706469731,v1:127.0.0.1:6827/1706469731] [v2:127.0.0.1:6828/1706469731,v1:127.0.0.1:6829/1706469731] exists,up 140388a4-2119-44d1-9b9e-b103065f627e 2026-02-17T08:35:56.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:35:56.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:35:56.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:35:56.906 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-17T08:35:56.906 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:35:56.907 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:35:56.907 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:35:56.907 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:35:56.907 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:35:56.907 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.0.asok 2026-02-17T08:35:56.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-17T08:35:56.908 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.0.asok log flush 2026-02-17T08:35:56.961 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:35:56.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-17T08:35:56.969 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:35:25.652+0000 7f23d19e38c0 0 load: jerasure load: lrc 2026-02-17T08:35:56.970 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:270: TEST_rados_get_subread_eio_shard_1: local poolname=pool-jerasure 2026-02-17T08:35:56.971 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:271: TEST_rados_get_subread_eio_shard_1: create_erasure_coded_pool pool-jerasure 2 1 2026-02-17T08:35:56.971 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:35:56.971 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-17T08:35:56.971 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=2 2026-02-17T08:35:56.971 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-17T08:35:56.971 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=1 2026-02-17T08:35:56.971 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-17T08:35:56.971 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=2 m=1 crush-failure-domain=osd 2026-02-17T08:35:57.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-17T08:35:57.225 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-17T08:35:57.588 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' already exists 2026-02-17T08:35:57.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:35:58.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-17T08:35:58.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:35:58.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:35:58.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:35:58.589 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:35:58.589 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:35:58.589 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:35:58.590 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:35:58.590 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:35:58.590 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:35:58.698 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:35:58.698 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:35:58.698 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:35:58.699 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:35:58.699 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:35:58.699 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:35:58.899 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:35:58.899 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:35:58.900 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:35:58.900 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:35:58.900 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:35:58.900 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:35:58.900 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:35:58.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803784 2026-02-17T08:35:58.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803784 2026-02-17T08:35:58.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803784' 2026-02-17T08:35:58.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:35:58.974 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:35:59.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=55834574855 2026-02-17T08:35:59.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 55834574855 2026-02-17T08:35:59.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803784 1-55834574855' 2026-02-17T08:35:59.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:35:59.050 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:35:59.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411333 2026-02-17T08:35:59.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411333 2026-02-17T08:35:59.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803784 1-55834574855 2-77309411333' 2026-02-17T08:35:59.125 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:35:59.125 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:35:59.204 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=111669149700 2026-02-17T08:35:59.204 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 111669149700 2026-02-17T08:35:59.204 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803784 1-55834574855 2-77309411333 3-111669149700' 2026-02-17T08:35:59.204 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:35:59.205 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803784 2026-02-17T08:35:59.205 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:35:59.206 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:35:59.207 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803784 2026-02-17T08:35:59.207 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:35:59.208 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803784 2026-02-17T08:35:59.208 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803784' 2026-02-17T08:35:59.209 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 25769803784 2026-02-17T08:35:59.209 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:35:59.406 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803782 -lt 25769803784 2026-02-17T08:35:59.406 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:36:00.407 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:36:00.407 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:36:00.603 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803785 -lt 25769803784 2026-02-17T08:36:00.603 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:36:00.604 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-55834574855 2026-02-17T08:36:00.604 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:36:00.605 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:36:00.606 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-55834574855 2026-02-17T08:36:00.606 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:36:00.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=55834574855 2026-02-17T08:36:00.608 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 55834574855 2026-02-17T08:36:00.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 55834574855' 2026-02-17T08:36:00.609 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:36:00.810 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 55834574855 -lt 55834574855 2026-02-17T08:36:00.810 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:36:00.811 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-77309411333 2026-02-17T08:36:00.811 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:36:00.812 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:36:00.813 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-77309411333 2026-02-17T08:36:00.813 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:36:00.814 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411333 2026-02-17T08:36:00.814 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 77309411333 2026-02-17T08:36:00.815 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 77309411333' 2026-02-17T08:36:00.815 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:36:01.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411333 -lt 77309411333 2026-02-17T08:36:01.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:36:01.023 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-111669149700 2026-02-17T08:36:01.023 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:36:01.024 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:36:01.025 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-111669149700 2026-02-17T08:36:01.025 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:36:01.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=111669149700 2026-02-17T08:36:01.028 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 111669149700 2026-02-17T08:36:01.029 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 111669149700' 2026-02-17T08:36:01.029 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:36:01.231 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 111669149700 -lt 111669149700 2026-02-17T08:36:01.231 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:36:01.232 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:36:01.232 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:36:01.491 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:36:01.491 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:36:01.491 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:36:01.491 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:36:01.491 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:36:01.491 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:36:01.492 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:36:01.492 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:36:01.688 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:36:01.688 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:36:01.689 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:36:01.689 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:36:01.947 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:36:01.947 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:36:01.947 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:36:01.947 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:273: TEST_rados_get_subread_eio_shard_1: local shard_id=1 2026-02-17T08:36:01.947 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:274: TEST_rados_get_subread_eio_shard_1: rados_put_get_data eio td/test-erasure-eio 1 2026-02-17T08:36:01.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:147: rados_put_get_data: local inject=eio 2026-02-17T08:36:01.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:148: rados_put_get_data: shift 2026-02-17T08:36:01.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:149: rados_put_get_data: local dir=td/test-erasure-eio 2026-02-17T08:36:01.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:150: rados_put_get_data: shift 2026-02-17T08:36:01.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:151: rados_put_get_data: local shard_id=1 2026-02-17T08:36:01.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:152: rados_put_get_data: shift 2026-02-17T08:36:01.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:153: rados_put_get_data: local arg= 2026-02-17T08:36:01.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:157: rados_put_get_data: local poolname=pool-jerasure 2026-02-17T08:36:01.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:158: rados_put_get_data: local objname=obj-eio-70936-1 2026-02-17T08:36:01.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:159: rados_put_get_data: rados_put td/test-erasure-eio pool-jerasure obj-eio-70936-1 2026-02-17T08:36:01.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-17T08:36:01.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-17T08:36:01.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-eio-70936-1 2026-02-17T08:36:01.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:36:01.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-17T08:36:01.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:36:01.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-17T08:36:01.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:36:01.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-17T08:36:01.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:36:01.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-17T08:36:01.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-eio-70936-1 td/test-erasure-eio/ORIGINAL 2026-02-17T08:36:01.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:160: rados_put_get_data: inject_eio ec data pool-jerasure obj-eio-70936-1 td/test-erasure-eio 1 2026-02-17T08:36:01.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2457: inject_eio: local pooltype=ec 2026-02-17T08:36:01.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2458: inject_eio: shift 2026-02-17T08:36:01.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2459: inject_eio: local which=data 2026-02-17T08:36:01.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2460: inject_eio: shift 2026-02-17T08:36:01.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2461: inject_eio: local poolname=pool-jerasure 2026-02-17T08:36:01.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2462: inject_eio: shift 2026-02-17T08:36:01.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2463: inject_eio: local objname=obj-eio-70936-1 2026-02-17T08:36:01.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2464: inject_eio: shift 2026-02-17T08:36:01.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2465: inject_eio: local dir=td/test-erasure-eio 2026-02-17T08:36:01.967 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2466: inject_eio: shift 2026-02-17T08:36:01.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2467: inject_eio: local shard_id=1 2026-02-17T08:36:01.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2468: inject_eio: shift 2026-02-17T08:36:01.968 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: get_osds pool-jerasure obj-eio-70936-1 2026-02-17T08:36:01.968 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:36:01.968 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj-eio-70936-1 2026-02-17T08:36:01.968 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj-eio-70936-1 2026-02-17T08:36:01.968 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:36:02.165 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:36:02.165 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:36:02.165 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:36:02.165 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 2 2026-02-17T08:36:02.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: initial_osds=('3' '1' '2') 2026-02-17T08:36:02.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: local -a initial_osds 2026-02-17T08:36:02.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2471: inject_eio: local osd_id=1 2026-02-17T08:36:02.166 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2472: inject_eio: '[' ec '!=' ec ']' 2026-02-17T08:36:02.166 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: cat td/test-erasure-eio/1/type 2026-02-17T08:36:02.167 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: type=bluestore 2026-02-17T08:36:02.167 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2476: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-17T08:36:02.167 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1161: set_config: local daemon=osd 2026-02-17T08:36:02.167 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1162: set_config: local id=1 2026-02-17T08:36:02.167 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1163: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T08:36:02.167 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1164: set_config: local value=true 2026-02-17T08:36:02.168 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: jq 'has("success")' 2026-02-17T08:36:02.168 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: get_asok_path osd.1 2026-02-17T08:36:02.169 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2026-02-17T08:36:02.169 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2026-02-17T08:36:02.169 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:36:02.170 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:36:02.170 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:36:02.170 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.1.asok 2026-02-17T08:36:02.170 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.70936/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-17T08:36:02.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: test true == true 2026-02-17T08:36:02.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2477: inject_eio: local loop=0 2026-02-17T08:36:02.230 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2479: inject_eio: grep -q Invalid 2026-02-17T08:36:02.230 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: get_asok_path osd.1 2026-02-17T08:36:02.230 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2026-02-17T08:36:02.230 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2026-02-17T08:36:02.231 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:36:02.231 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:36:02.231 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:36:02.231 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.1.asok 2026-02-17T08:36:02.231 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: CEPH_ARGS= 2026-02-17T08:36:02.231 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.1.asok injectdataerr pool-jerasure obj-eio-70936-1 1 2026-02-17T08:36:02.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:161: rados_put_get_data: rados_get td/test-erasure-eio pool-jerasure obj-eio-70936-1 2026-02-17T08:36:02.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:36:02.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:36:02.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-eio-70936-1 2026-02-17T08:36:02.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-17T08:36:02.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-17T08:36:02.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-eio-70936-1 td/test-erasure-eio/COPY 2026-02-17T08:36:02.310 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-17T08:36:02.310 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-17T08:36:02.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:163: rados_put_get_data: '[' '' = recovery ']' 2026-02-17T08:36:02.312 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:181: rados_put_get_data: expr 1 + 1 2026-02-17T08:36:02.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:181: rados_put_get_data: shard_id=2 2026-02-17T08:36:02.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:182: rados_put_get_data: inject_eio ec data pool-jerasure obj-eio-70936-1 td/test-erasure-eio 2 2026-02-17T08:36:02.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2457: inject_eio: local pooltype=ec 2026-02-17T08:36:02.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2458: inject_eio: shift 2026-02-17T08:36:02.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2459: inject_eio: local which=data 2026-02-17T08:36:02.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2460: inject_eio: shift 2026-02-17T08:36:02.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2461: inject_eio: local poolname=pool-jerasure 2026-02-17T08:36:02.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2462: inject_eio: shift 2026-02-17T08:36:02.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2463: inject_eio: local objname=obj-eio-70936-1 2026-02-17T08:36:02.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2464: inject_eio: shift 2026-02-17T08:36:02.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2465: inject_eio: local dir=td/test-erasure-eio 2026-02-17T08:36:02.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2466: inject_eio: shift 2026-02-17T08:36:02.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2467: inject_eio: local shard_id=2 2026-02-17T08:36:02.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2468: inject_eio: shift 2026-02-17T08:36:02.315 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: get_osds pool-jerasure obj-eio-70936-1 2026-02-17T08:36:02.315 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:36:02.315 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj-eio-70936-1 2026-02-17T08:36:02.315 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj-eio-70936-1 2026-02-17T08:36:02.315 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:36:02.516 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:36:02.517 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:36:02.517 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:36:02.517 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 2 2026-02-17T08:36:02.517 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: initial_osds=('3' '1' '2') 2026-02-17T08:36:02.517 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: local -a initial_osds 2026-02-17T08:36:02.517 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2471: inject_eio: local osd_id=2 2026-02-17T08:36:02.517 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2472: inject_eio: '[' ec '!=' ec ']' 2026-02-17T08:36:02.517 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: cat td/test-erasure-eio/2/type 2026-02-17T08:36:02.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: type=bluestore 2026-02-17T08:36:02.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2476: inject_eio: set_config osd 2 bluestore_debug_inject_read_err true 2026-02-17T08:36:02.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1161: set_config: local daemon=osd 2026-02-17T08:36:02.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1162: set_config: local id=2 2026-02-17T08:36:02.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1163: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T08:36:02.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1164: set_config: local value=true 2026-02-17T08:36:02.519 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: jq 'has("success")' 2026-02-17T08:36:02.519 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: get_asok_path osd.2 2026-02-17T08:36:02.519 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2026-02-17T08:36:02.519 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2026-02-17T08:36:02.520 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:36:02.520 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:36:02.520 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:36:02.521 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.2.asok 2026-02-17T08:36:02.521 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.70936/ceph-osd.2.asok config set bluestore_debug_inject_read_err true 2026-02-17T08:36:02.580 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: test true == true 2026-02-17T08:36:02.580 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2477: inject_eio: local loop=0 2026-02-17T08:36:02.581 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2479: inject_eio: grep -q Invalid 2026-02-17T08:36:02.581 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: get_asok_path osd.2 2026-02-17T08:36:02.581 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2026-02-17T08:36:02.581 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2026-02-17T08:36:02.581 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:36:02.581 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:36:02.582 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:36:02.582 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.2.asok 2026-02-17T08:36:02.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: CEPH_ARGS= 2026-02-17T08:36:02.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.2.asok injectdataerr pool-jerasure obj-eio-70936-1 2 2026-02-17T08:36:02.639 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:183: rados_put_get_data: rados_get td/test-erasure-eio pool-jerasure obj-eio-70936-1 fail 2026-02-17T08:36:02.639 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:36:02.639 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:36:02.639 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-eio-70936-1 2026-02-17T08:36:02.639 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=fail 2026-02-17T08:36:02.640 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' fail = fail ']' 2026-02-17T08:36:02.640 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:114: rados_get: rados --pool pool-jerasure get obj-eio-70936-1 td/test-erasure-eio/COPY 2026-02-17T08:36:02.656 INFO:tasks.workunit.client.0.trial059.stderr:error getting pool-jerasure/obj-eio-70936-1: (5) Input/output error 2026-02-17T08:36:02.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:115: rados_get: return 2026-02-17T08:36:02.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:184: rados_put_get_data: rm td/test-erasure-eio/ORIGINAL 2026-02-17T08:36:02.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:275: TEST_rados_get_subread_eio_shard_1: delete_erasure_coded_pool pool-jerasure 2026-02-17T08:36:02.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:36:02.659 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-17T08:36:02.913 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' does not exist 2026-02-17T08:36:02.922 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-17T08:36:03.218 INFO:tasks.workunit.client.0.trial059.stderr:erasure-code-profile myprofile does not exist 2026-02-17T08:36:03.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-17T08:36:03.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:36:03.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:36:03.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:36:03.228 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:36:03.229 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:36:03.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:36:03.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:36:03.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:36:03.541 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:36:03.542 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:36:03.543 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:36:03.544 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:36:03.545 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:36:03.545 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:36:03.546 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:36:03.547 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:36:03.547 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:36:03.548 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:36:03.548 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:36:03.549 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:36:03.550 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:36:03.550 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:36:03.562 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:36:03.562 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:36:03.562 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:36:03.562 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:36:03.564 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:36:03.564 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:36:03.564 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-17T08:36:03.564 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-17T08:36:03.564 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-eio 2026-02-17T08:36:03.564 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-eio 2026-02-17T08:36:03.564 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:36:03.564 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:36:03.564 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:36:03.565 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:36:03.565 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:36:03.565 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:36:03.565 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:36:03.565 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:36:03.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:36:03.568 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:36:03.569 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:36:03.569 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:36:03.570 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:36:03.570 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:36:03.571 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:36:03.571 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:36:03.571 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:36:03.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:36:03.572 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:36:03.573 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:36:03.574 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:36:03.574 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:36:03.575 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:36:03.576 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:36:03.576 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:36:03.576 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:36:03.577 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:36:03.577 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:36:03.577 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-eio 2026-02-17T08:36:03.579 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:36:03.579 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:36:03.579 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:36:03.579 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.70936 2026-02-17T08:36:03.581 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:36:03.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:36:03.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:36:03.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-17T08:36:03.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-17T08:36:03.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-eio 2026-02-17T08:36:03.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:36:03.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:36:03.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:36:03.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-eio/a 2026-02-17T08:36:03.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-17T08:36:03.603 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:36:03.603 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:36:03.603 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:36:03.603 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:36:03.603 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:36:03.603 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:36:03.604 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:36:03.604 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T08:36:03.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:36:03.633 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:36:03.633 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:36:03.633 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:36:03.633 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:36:03.634 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:36:03.635 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:36:03.635 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:36:03.635 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:36:03.635 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:36:03.635 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:36:03.635 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:36:03.635 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:36:03.636 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:36:03.636 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get fsid 2026-02-17T08:36:03.690 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:36:03.691 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:36:03.691 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:36:03.691 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:36:03.691 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:36:03.691 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:36:03.691 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:36:03.691 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:36:03.692 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:36:03.692 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:36:03.692 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:36:03.692 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:36:03.692 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:36:03.692 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get mon_host 2026-02-17T08:36:03.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-17T08:36:03.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-eio 2026-02-17T08:36:03.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:36:03.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:36:03.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:36:03.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-eio/x 2026-02-17T08:36:03.748 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:36:03.859 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:36:03.859 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:36:03.859 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:36:03.859 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:36:03.859 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:36:03.859 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:36:03.860 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:36:03.860 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:36:03.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:36:03.879 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-17T08:36:03.879 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T08:36:03.992 INFO:tasks.workunit.client.0.trial059.stderr:pool 'rbd' already exists 2026-02-17T08:36:04.000 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:36:05.001 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-17T08:36:05.002 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:36:05.002 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:36:05.003 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:36:05.003 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:36:05.003 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:36:05.003 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:36:05.003 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-17T08:36:05.003 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-mon.a.asok log flush 2026-02-17T08:36:05.052 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:36:05.057 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-17T08:36:05.059 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:36:03.608+0000 7f79c548dec0 0 load: jerasure load: lrc 2026-02-17T08:36:05.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_rados_get_subread_missing td/test-erasure-eio 2026-02-17T08:36:05.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:282: TEST_rados_get_subread_missing: local dir=td/test-erasure-eio 2026-02-17T08:36:05.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:283: TEST_rados_get_subread_missing: setup_osds 4 2026-02-17T08:36:05.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=4 2026-02-17T08:36:05.060 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-17T08:36:05.060 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 4 - 1 2026-02-17T08:36:05.061 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 3 2026-02-17T08:36:05.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:36:05.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-17T08:36:05.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:36:05.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:36:05.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:36:05.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:36:05.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-17T08:36:05.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:36:05.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:36:05.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:36:05.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:36:05.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-17T08:36:05.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-17T08:36:05.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:36:05.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:36:05.063 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:36:05.064 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:36:05.065 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:36:05.065 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:36:05.065 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:36:05.065 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:36:05.065 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:36:05.065 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:36:05.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:36:05.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:36:05.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:36:05.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:36:05.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:36:05.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:36:05.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:36:05.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:36:05.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:36:05.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:36:05.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:36:05.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:36:05.065 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-17T08:36:05.066 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:36:05.067 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=886b135f-ab33-46d6-9239-d42c5f4712a2 2026-02-17T08:36:05.067 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 886b135f-ab33-46d6-9239-d42c5f4712a2' 2026-02-17T08:36:05.067 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 886b135f-ab33-46d6-9239-d42c5f4712a2 2026-02-17T08:36:05.067 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:36:05.077 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQB1KJRp4cwCBBAAm6DKR9YO2LjuVEx2PycmWA== 2026-02-17T08:36:05.077 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQB1KJRp4cwCBBAAm6DKR9YO2LjuVEx2PycmWA=="}' 2026-02-17T08:36:05.078 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 886b135f-ab33-46d6-9239-d42c5f4712a2 -i td/test-erasure-eio/0/new.json 2026-02-17T08:36:05.189 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:36:05.196 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-17T08:36:05.198 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB1KJRp4cwCBBAAm6DKR9YO2LjuVEx2PycmWA== --osd-uuid 886b135f-ab33-46d6-9239-d42c5f4712a2 2026-02-17T08:36:05.213 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:05.200+0000 7fa5df7938c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:05.215 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:05.200+0000 7fa5df7938c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:05.216 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:05.204+0000 7fa5df7938c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:05.216 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:05.204+0000 7fa5df7938c0 -1 bdev(0x55e069131c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:36:05.216 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:05.204+0000 7fa5df7938c0 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-17T08:36:07.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-17T08:36:07.736 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:36:07.737 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:36:07.737 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:36:07.737 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:36:08.009 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:36:08.009 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:36:08.009 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:36:08.009 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:36:08.009 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:36:08.009 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:36:08.032 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:08.020+0000 7f7476a8e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:08.034 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:08.020+0000 7f7476a8e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:08.035 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:08.020+0000 7f7476a8e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:08.208 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:36:08.208 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:36:08.208 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:36:08.209 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:36:08.209 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:36:08.209 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:08.209 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:36:08.210 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:36:08.210 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:08.210 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:36:08.404 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:36:09.406 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:36:09.406 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:09.406 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:36:09.407 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:36:09.407 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:09.407 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:36:09.604 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:36:09.774 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:09.760+0000 7f7476a8e8c0 -1 Falling back to public interface 2026-02-17T08:36:10.605 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:36:10.605 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:10.605 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:36:10.605 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:36:10.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:10.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:36:10.807 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:36:11.809 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:36:11.809 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:11.809 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:36:11.809 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:36:11.809 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:11.809 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:36:12.004 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:36:12.778 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:12.764+0000 7f7476a8e8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:36:13.005 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:36:13.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:13.006 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:36:13.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:36:13.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:13.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:36:13.206 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:36:14.208 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:36:14.208 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:14.208 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:36:14.208 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:36:14.209 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:14.209 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:36:14.405 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1214047538,v1:127.0.0.1:6803/1214047538] [v2:127.0.0.1:6804/1214047538,v1:127.0.0.1:6805/1214047538] exists,up 886b135f-ab33-46d6-9239-d42c5f4712a2 2026-02-17T08:36:14.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:36:14.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:36:14.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:36:14.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:36:14.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-17T08:36:14.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:36:14.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:36:14.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T08:36:14.409 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:36:14.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-17T08:36:14.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:36:14.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:36:14.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:36:14.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:36:14.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-17T08:36:14.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-17T08:36:14.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:36:14.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:36:14.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:36:14.410 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:36:14.410 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:36:14.410 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:36:14.411 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:36:14.411 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:36:14.411 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:36:14.411 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:36:14.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:36:14.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:36:14.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:36:14.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:36:14.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:36:14.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:36:14.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:36:14.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:36:14.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:36:14.412 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:36:14.412 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:36:14.412 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:36:14.412 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-17T08:36:14.412 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:36:14.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=df767614-cf4f-4eda-a178-7d81c5e29fb5 2026-02-17T08:36:14.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 df767614-cf4f-4eda-a178-7d81c5e29fb5' 2026-02-17T08:36:14.413 INFO:tasks.workunit.client.0.trial059.stdout:add osd1 df767614-cf4f-4eda-a178-7d81c5e29fb5 2026-02-17T08:36:14.413 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:36:14.423 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQB+KJRpt7GQGBAARxTsB546iRxT7/O2IPYDrQ== 2026-02-17T08:36:14.423 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQB+KJRpt7GQGBAARxTsB546iRxT7/O2IPYDrQ=="}' 2026-02-17T08:36:14.423 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new df767614-cf4f-4eda-a178-7d81c5e29fb5 -i td/test-erasure-eio/1/new.json 2026-02-17T08:36:14.624 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:36:14.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-17T08:36:14.634 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB+KJRpt7GQGBAARxTsB546iRxT7/O2IPYDrQ== --osd-uuid df767614-cf4f-4eda-a178-7d81c5e29fb5 2026-02-17T08:36:14.649 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:14.636+0000 7f9d5fb1b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:14.650 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:14.636+0000 7f9d5fb1b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:14.652 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:14.640+0000 7f9d5fb1b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:14.652 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:14.640+0000 7f9d5fb1b8c0 -1 bdev(0x564b9ffebc00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-17T08:36:14.652 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:14.640+0000 7f9d5fb1b8c0 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-17T08:36:16.921 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-17T08:36:16.921 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:36:16.922 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T08:36:16.922 INFO:tasks.workunit.client.0.trial059.stdout:adding osd1 key to auth repository 2026-02-17T08:36:16.922 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:36:17.193 INFO:tasks.workunit.client.0.trial059.stdout:start osd.1 2026-02-17T08:36:17.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T08:36:17.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:36:17.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:36:17.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:36:17.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:36:17.216 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:17.204+0000 7f4b3f9ad8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:17.218 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:17.204+0000 7f4b3f9ad8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:17.219 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:17.204+0000 7f4b3f9ad8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:17.395 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T08:36:17.395 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:36:17.395 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:36:17.396 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:36:17.396 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:36:17.396 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:17.396 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:36:17.396 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:36:17.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:17.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:36:17.590 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:36:18.591 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:36:18.592 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:18.592 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:36:18.593 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:36:18.593 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:18.593 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:36:18.749 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:18.736+0000 7f4b3f9ad8c0 -1 Falling back to public interface 2026-02-17T08:36:18.787 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:36:19.788 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:36:19.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:19.789 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:36:19.790 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:36:19.790 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:19.790 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:36:19.981 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:36:20.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:36:20.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:20.982 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:36:20.983 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:36:20.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:20.983 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:36:21.176 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:36:21.735 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:21.720+0000 7f4b3f9ad8c0 -1 osd.1 0 log_to_monitors true 2026-02-17T08:36:22.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:36:22.178 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:22.179 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:36:22.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:36:22.179 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:22.180 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:36:22.375 INFO:tasks.workunit.client.0.trial059.stdout:osd.1 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/216606853,v1:127.0.0.1:6811/216606853] [v2:127.0.0.1:6812/216606853,v1:127.0.0.1:6813/216606853] exists,up df767614-cf4f-4eda-a178-7d81c5e29fb5 2026-02-17T08:36:22.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:36:22.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:36:22.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:36:22.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:36:22.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-17T08:36:22.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:36:22.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:36:22.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T08:36:22.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:36:22.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-17T08:36:22.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:36:22.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:36:22.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:36:22.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:36:22.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-17T08:36:22.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-17T08:36:22.380 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:36:22.381 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:36:22.381 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:36:22.381 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:36:22.381 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:36:22.381 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:36:22.381 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:36:22.381 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:36:22.381 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:36:22.381 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:36:22.381 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:36:22.381 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:36:22.381 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:36:22.381 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:36:22.382 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:36:22.382 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:36:22.382 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:36:22.382 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:36:22.382 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:36:22.382 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:36:22.382 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:36:22.382 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:36:22.382 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-17T08:36:22.382 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:36:22.383 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=632e74eb-4441-4dd8-9e1c-a9485fc279c8 2026-02-17T08:36:22.383 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 632e74eb-4441-4dd8-9e1c-a9485fc279c8' 2026-02-17T08:36:22.383 INFO:tasks.workunit.client.0.trial059.stdout:add osd2 632e74eb-4441-4dd8-9e1c-a9485fc279c8 2026-02-17T08:36:22.384 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:36:22.393 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCGKJRpapbKFhAAJNbyBRVA4DznNd7wAzTlfg== 2026-02-17T08:36:22.393 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCGKJRpapbKFhAAJNbyBRVA4DznNd7wAzTlfg=="}' 2026-02-17T08:36:22.393 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 632e74eb-4441-4dd8-9e1c-a9485fc279c8 -i td/test-erasure-eio/2/new.json 2026-02-17T08:36:22.598 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:36:22.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-17T08:36:22.608 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCGKJRpapbKFhAAJNbyBRVA4DznNd7wAzTlfg== --osd-uuid 632e74eb-4441-4dd8-9e1c-a9485fc279c8 2026-02-17T08:36:22.624 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:22.612+0000 7f4db85048c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:22.625 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:22.612+0000 7f4db85048c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:22.627 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:22.612+0000 7f4db85048c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:22.627 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:22.612+0000 7f4db85048c0 -1 bdev(0x560de950fc00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-17T08:36:22.627 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:22.616+0000 7f4db85048c0 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-17T08:36:24.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-17T08:36:24.904 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:36:24.905 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T08:36:24.906 INFO:tasks.workunit.client.0.trial059.stdout:adding osd2 key to auth repository 2026-02-17T08:36:24.906 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:36:25.184 INFO:tasks.workunit.client.0.trial059.stdout:start osd.2 2026-02-17T08:36:25.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T08:36:25.185 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:36:25.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:36:25.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:36:25.186 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:36:25.200 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:25.188+0000 7f2a492138c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:25.202 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:25.188+0000 7f2a492138c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:25.203 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:25.188+0000 7f2a492138c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:25.384 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T08:36:25.384 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:36:25.385 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:36:25.385 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:36:25.385 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:36:25.385 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:25.385 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:36:25.385 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:36:25.386 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:25.386 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:36:25.581 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:36:26.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:36:26.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:26.583 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:36:26.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:36:26.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:26.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:36:26.725 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:26.712+0000 7f2a492138c0 -1 Falling back to public interface 2026-02-17T08:36:26.777 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:36:27.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:36:27.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:27.779 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:36:27.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:36:27.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:27.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:36:27.974 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:36:28.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:36:28.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:28.976 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:36:28.977 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:36:28.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:28.977 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:36:29.170 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:36:29.755 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:29.740+0000 7f2a492138c0 -1 osd.2 0 log_to_monitors true 2026-02-17T08:36:30.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:36:30.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:30.171 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:36:30.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:36:30.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:30.171 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:36:30.376 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:36:31.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:36:31.378 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:31.378 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:36:31.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:36:31.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:31.379 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:36:31.579 INFO:tasks.workunit.client.0.trial059.stdout:osd.2 up in weight 1 up_from 18 up_thru 20 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2201831711,v1:127.0.0.1:6819/2201831711] [v2:127.0.0.1:6820/2201831711,v1:127.0.0.1:6821/2201831711] exists,up 632e74eb-4441-4dd8-9e1c-a9485fc279c8 2026-02-17T08:36:31.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:36:31.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:36:31.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:36:31.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:36:31.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-17T08:36:31.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:36:31.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:36:31.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2026-02-17T08:36:31.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:36:31.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-17T08:36:31.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:36:31.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:36:31.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:36:31.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:36:31.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-17T08:36:31.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-17T08:36:31.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:36:31.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:36:31.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:36:31.584 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:36:31.584 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:36:31.585 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:36:31.585 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:36:31.585 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:36:31.585 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:36:31.585 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:36:31.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:36:31.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:36:31.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:36:31.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:36:31.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:36:31.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:36:31.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:36:31.585 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:36:31.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:36:31.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:36:31.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:36:31.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:36:31.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-17T08:36:31.587 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:36:31.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=69fd82a0-54f1-4e74-a4e3-fb2da3ad7591 2026-02-17T08:36:31.587 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 69fd82a0-54f1-4e74-a4e3-fb2da3ad7591' 2026-02-17T08:36:31.587 INFO:tasks.workunit.client.0.trial059.stdout:add osd3 69fd82a0-54f1-4e74-a4e3-fb2da3ad7591 2026-02-17T08:36:31.588 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:36:31.597 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCPKJRp0475IhAAhihQzIoefWS92x9vx+L90g== 2026-02-17T08:36:31.597 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCPKJRp0475IhAAhihQzIoefWS92x9vx+L90g=="}' 2026-02-17T08:36:31.597 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 69fd82a0-54f1-4e74-a4e3-fb2da3ad7591 -i td/test-erasure-eio/3/new.json 2026-02-17T08:36:31.801 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:36:31.810 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-17T08:36:31.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCPKJRp0475IhAAhihQzIoefWS92x9vx+L90g== --osd-uuid 69fd82a0-54f1-4e74-a4e3-fb2da3ad7591 2026-02-17T08:36:31.827 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:31.816+0000 7fa1f167f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:31.828 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:31.816+0000 7fa1f167f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:31.829 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:31.816+0000 7fa1f167f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:31.829 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:31.816+0000 7fa1f167f8c0 -1 bdev(0x55ac48379c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-17T08:36:31.830 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:31.816+0000 7fa1f167f8c0 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-17T08:36:34.100 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-17T08:36:34.100 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:36:34.101 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2026-02-17T08:36:34.101 INFO:tasks.workunit.client.0.trial059.stdout:adding osd3 key to auth repository 2026-02-17T08:36:34.102 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:36:34.372 INFO:tasks.workunit.client.0.trial059.stdout:start osd.3 2026-02-17T08:36:34.372 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2026-02-17T08:36:34.373 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:36:34.373 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:36:34.373 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:36:34.373 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:36:34.394 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:34.380+0000 7faf599148c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:34.396 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:34.384+0000 7faf599148c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:34.397 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:34.384+0000 7faf599148c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:34.573 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2026-02-17T08:36:34.573 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:36:34.573 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T08:36:34.573 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:36:34.573 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:36:34.573 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:34.573 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:36:34.574 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:36:34.574 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:34.574 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:36:34.769 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:36:35.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:36:35.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:35.770 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:36:35.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:36:35.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:35.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:36:35.884 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:35.872+0000 7faf599148c0 -1 Falling back to public interface 2026-02-17T08:36:35.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:36:36.968 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:36:36.969 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:36.969 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:36:36.970 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:36:36.970 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:36.971 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:36:37.159 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:36:38.161 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:36:38.161 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:38.161 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:36:38.162 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:36:38.162 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:38.162 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:36:38.357 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:36:39.114 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:39.100+0000 7faf599148c0 -1 osd.3 0 log_to_monitors true 2026-02-17T08:36:39.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:36:39.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:39.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:36:39.358 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:36:39.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:39.358 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:36:39.554 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:36:40.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:36:40.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:40.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:36:40.555 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:36:40.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:40.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:36:40.751 INFO:tasks.workunit.client.0.trial059.stdout:osd.3 up in weight 1 up_from 27 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3755250151,v1:127.0.0.1:6827/3755250151] [v2:127.0.0.1:6828/3755250151,v1:127.0.0.1:6829/3755250151] exists,up 69fd82a0-54f1-4e74-a4e3-fb2da3ad7591 2026-02-17T08:36:40.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:36:40.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:36:40.753 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:36:40.753 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-17T08:36:40.753 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:36:40.753 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:36:40.753 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:36:40.754 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:36:40.754 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:36:40.754 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.0.asok 2026-02-17T08:36:40.754 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-17T08:36:40.755 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.0.asok log flush 2026-02-17T08:36:40.814 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:36:40.819 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-17T08:36:40.821 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:36:09.764+0000 7f7476a8e8c0 0 load: jerasure load: lrc 2026-02-17T08:36:40.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:285: TEST_rados_get_subread_missing: local poolname=pool-jerasure 2026-02-17T08:36:40.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:286: TEST_rados_get_subread_missing: create_erasure_coded_pool pool-jerasure 2 1 2026-02-17T08:36:40.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:36:40.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-17T08:36:40.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=2 2026-02-17T08:36:40.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-17T08:36:40.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=1 2026-02-17T08:36:40.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-17T08:36:40.822 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=2 m=1 crush-failure-domain=osd 2026-02-17T08:36:41.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-17T08:36:41.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-17T08:36:41.386 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' already exists 2026-02-17T08:36:41.395 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:36:42.396 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-17T08:36:42.396 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:36:42.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:36:42.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:36:42.397 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:36:42.398 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:36:42.398 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:36:42.398 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:36:42.398 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:36:42.398 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:36:42.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:36:42.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:36:42.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:36:42.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:36:42.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:36:42.515 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:36:42.715 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:36:42.715 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:36:42.715 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:36:42.715 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:36:42.715 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:36:42.716 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:36:42.716 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:36:42.793 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803784 2026-02-17T08:36:42.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803784 2026-02-17T08:36:42.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803784' 2026-02-17T08:36:42.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:36:42.794 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:36:42.870 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=55834574854 2026-02-17T08:36:42.870 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 55834574854 2026-02-17T08:36:42.870 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803784 1-55834574854' 2026-02-17T08:36:42.870 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:36:42.870 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:36:42.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411334 2026-02-17T08:36:42.948 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411334 2026-02-17T08:36:42.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803784 1-55834574854 2-77309411334' 2026-02-17T08:36:42.949 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:36:42.949 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:36:43.022 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=115964116995 2026-02-17T08:36:43.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 115964116995 2026-02-17T08:36:43.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803784 1-55834574854 2-77309411334 3-115964116995' 2026-02-17T08:36:43.023 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:36:43.023 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803784 2026-02-17T08:36:43.023 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:36:43.025 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:36:43.025 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803784 2026-02-17T08:36:43.025 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:36:43.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803784 2026-02-17T08:36:43.027 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 25769803784 2026-02-17T08:36:43.027 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803784' 2026-02-17T08:36:43.028 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:36:43.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803782 -lt 25769803784 2026-02-17T08:36:43.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:36:44.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:36:44.229 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:36:44.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803785 -lt 25769803784 2026-02-17T08:36:44.426 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:36:44.427 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-55834574854 2026-02-17T08:36:44.427 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:36:44.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:36:44.429 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-55834574854 2026-02-17T08:36:44.429 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:36:44.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=55834574854 2026-02-17T08:36:44.431 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 55834574854' 2026-02-17T08:36:44.431 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 55834574854 2026-02-17T08:36:44.431 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:36:44.635 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 55834574855 -lt 55834574854 2026-02-17T08:36:44.636 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:36:44.636 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-77309411334 2026-02-17T08:36:44.636 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:36:44.637 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:36:44.638 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-77309411334 2026-02-17T08:36:44.638 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:36:44.640 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411334 2026-02-17T08:36:44.640 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 77309411334 2026-02-17T08:36:44.641 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 77309411334' 2026-02-17T08:36:44.641 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:36:44.838 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411334 -lt 77309411334 2026-02-17T08:36:44.838 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:36:44.839 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-115964116995 2026-02-17T08:36:44.839 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:36:44.840 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:36:44.841 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-115964116995 2026-02-17T08:36:44.841 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:36:44.842 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=115964116995 2026-02-17T08:36:44.843 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 115964116995 2026-02-17T08:36:44.843 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 115964116995' 2026-02-17T08:36:44.843 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:36:45.052 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 115964116995 -lt 115964116995 2026-02-17T08:36:45.052 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:36:45.053 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:36:45.053 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:36:45.310 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:36:45.310 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:36:45.310 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:36:45.310 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:36:45.310 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:36:45.310 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:36:45.310 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:36:45.311 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:36:45.508 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:36:45.509 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:36:45.509 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:36:45.509 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:36:45.769 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:36:45.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:36:45.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:36:45.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:288: TEST_rados_get_subread_missing: local shard_id=1 2026-02-17T08:36:45.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:289: TEST_rados_get_subread_missing: rados_put_get_data remove td/test-erasure-eio 1 2026-02-17T08:36:45.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:147: rados_put_get_data: local inject=remove 2026-02-17T08:36:45.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:148: rados_put_get_data: shift 2026-02-17T08:36:45.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:149: rados_put_get_data: local dir=td/test-erasure-eio 2026-02-17T08:36:45.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:150: rados_put_get_data: shift 2026-02-17T08:36:45.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:151: rados_put_get_data: local shard_id=1 2026-02-17T08:36:45.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:152: rados_put_get_data: shift 2026-02-17T08:36:45.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:153: rados_put_get_data: local arg= 2026-02-17T08:36:45.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:157: rados_put_get_data: local poolname=pool-jerasure 2026-02-17T08:36:45.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:158: rados_put_get_data: local objname=obj-remove-70936-1 2026-02-17T08:36:45.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:159: rados_put_get_data: rados_put td/test-erasure-eio pool-jerasure obj-remove-70936-1 2026-02-17T08:36:45.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-17T08:36:45.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-17T08:36:45.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-remove-70936-1 2026-02-17T08:36:45.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:36:45.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-17T08:36:45.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:36:45.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-17T08:36:45.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:36:45.770 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-17T08:36:45.771 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:36:45.771 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-17T08:36:45.771 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-remove-70936-1 td/test-erasure-eio/ORIGINAL 2026-02-17T08:36:45.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:160: rados_put_get_data: inject_remove ec data pool-jerasure obj-remove-70936-1 td/test-erasure-eio 1 2026-02-17T08:36:45.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:127: inject_remove: local pooltype=ec 2026-02-17T08:36:45.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:128: inject_remove: shift 2026-02-17T08:36:45.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:129: inject_remove: local which=data 2026-02-17T08:36:45.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:130: inject_remove: shift 2026-02-17T08:36:45.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:131: inject_remove: local poolname=pool-jerasure 2026-02-17T08:36:45.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:132: inject_remove: shift 2026-02-17T08:36:45.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:133: inject_remove: local objname=obj-remove-70936-1 2026-02-17T08:36:45.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:134: inject_remove: shift 2026-02-17T08:36:45.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:135: inject_remove: local dir=td/test-erasure-eio 2026-02-17T08:36:45.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:136: inject_remove: shift 2026-02-17T08:36:45.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:137: inject_remove: local shard_id=1 2026-02-17T08:36:45.790 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:138: inject_remove: shift 2026-02-17T08:36:45.790 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:140: inject_remove: get_osds pool-jerasure obj-remove-70936-1 2026-02-17T08:36:45.790 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:36:45.790 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj-remove-70936-1 2026-02-17T08:36:45.790 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj-remove-70936-1 2026-02-17T08:36:45.790 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:36:45.988 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:36:45.988 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:36:45.988 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:36:45.988 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 2 2026-02-17T08:36:45.988 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:140: inject_remove: initial_osds=('3' '1' '2') 2026-02-17T08:36:45.988 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:140: inject_remove: local -a initial_osds 2026-02-17T08:36:45.988 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:141: inject_remove: local osd_id=1 2026-02-17T08:36:45.988 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:142: inject_remove: objectstore_tool td/test-erasure-eio 1 obj-remove-70936-1 remove 2026-02-17T08:36:45.989 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1297: objectstore_tool: local dir=td/test-erasure-eio 2026-02-17T08:36:45.989 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: objectstore_tool: shift 2026-02-17T08:36:45.989 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1299: objectstore_tool: local id=1 2026-02-17T08:36:45.989 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: objectstore_tool: shift 2026-02-17T08:36:45.989 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 1 obj-remove-70936-1 remove 2026-02-17T08:36:45.989 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-17T08:36:45.989 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2026-02-17T08:36:45.989 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=1 2026-02-17T08:36:45.989 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2026-02-17T08:36:45.989 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.1 2026-02-17T08:36:45.989 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:36:45.990 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:36:45.990 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:36:45.990 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:36:45.990 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:36:47.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:36:47.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 1 obj-remove-70936-1 remove 2026-02-17T08:36:47.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-17T08:36:47.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T08:36:47.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=1 2026-02-17T08:36:47.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T08:36:47.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/1 2026-02-17T08:36:47.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/1 obj-remove-70936-1 remove 2026-02-17T08:36:47.968 INFO:tasks.workunit.client.0.trial059.stdout:remove 1#2:18cbea2a:::obj-remove-70936-1:head# 2026-02-17T08:36:48.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 1 2026-02-17T08:36:48.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-eio 2026-02-17T08:36:48.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:36:48.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=1 2026-02-17T08:36:48.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:36:48.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-eio/1 2026-02-17T08:36:48.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:36:48.514 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:36:48.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:36:48.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:36:48.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-17T08:36:48.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-17T08:36:48.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:36:48.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:36:48.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:36:48.515 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:36:48.515 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:36:48.515 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:36:48.515 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:36:48.515 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:36:48.515 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:36:48.518 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:36:48.518 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:36:48.518 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:36:48.518 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:36:48.518 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:36:48.518 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:36:48.518 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:36:48.518 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:36:48.518 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:36:48.518 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:36:48.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:36:48.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-eio/1 2026-02-17T08:36:48.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.1 2026-02-17T08:36:48.519 INFO:tasks.workunit.client.0.trial059.stderr:start osd.1 2026-02-17T08:36:48.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:36:48.519 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-eio/1/whoami 2026-02-17T08:36:48.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 1 = 1 ']' 2026-02-17T08:36:48.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:36:48.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:36:48.519 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:36:48.534 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:48.520+0000 7f3dc18158c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:48.535 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:48.524+0000 7f3dc18158c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:48.536 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:48.524+0000 7f3dc18158c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:36:48.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 1 2026-02-17T08:36:48.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:36:48.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:36:48.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:36:48.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:36:48.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:48.720 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:36:48.720 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:36:48.720 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:48.720 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:36:48.916 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:36:49.745 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:49.732+0000 7f3dc18158c0 -1 Falling back to public interface 2026-02-17T08:36:49.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:36:49.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:49.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:36:49.917 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:36:49.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:49.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:36:50.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:36:51.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:36:51.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:51.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:36:51.116 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:36:51.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:51.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:36:51.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:36:52.312 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:36:52.312 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:52.312 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:36:52.312 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:36:52.312 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:52.312 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:36:52.505 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:36:53.012 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:36:53.000+0000 7f3dc18158c0 -1 osd.1 34 log_to_monitors true 2026-02-17T08:36:53.507 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:36:53.507 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:36:53.507 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:36:53.508 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:36:53.508 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:36:53.508 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:36:53.704 INFO:tasks.workunit.client.0.trial059.stderr:osd.1 up in weight 1 up_from 38 up_thru 38 down_at 35 last_clean_interval [13,34) [v2:127.0.0.1:6810/269956914,v1:127.0.0.1:6811/269956914] [v2:127.0.0.1:6812/269956914,v1:127.0.0.1:6813/269956914] exists,up df767614-cf4f-4eda-a178-7d81c5e29fb5 2026-02-17T08:36:53.704 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:36:53.704 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:36:53.704 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:36:53.704 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: objectstore_tool: wait_for_clean 2026-02-17T08:36:53.705 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:36:53.705 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:36:53.705 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:36:53.705 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:36:53.706 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:36:53.706 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:36:53.706 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:36:53.706 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:36:53.706 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:36:53.812 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:36:53.812 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:36:53.812 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:36:53.812 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:36:53.812 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:36:53.813 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:36:54.006 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:36:54.006 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:36:54.006 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:36:54.007 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:36:54.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:36:54.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:36:54.007 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:36:54.081 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803789 2026-02-17T08:36:54.082 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803789 2026-02-17T08:36:54.082 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803789' 2026-02-17T08:36:54.082 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:36:54.082 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:36:54.161 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=163208757251 2026-02-17T08:36:54.161 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 163208757251 2026-02-17T08:36:54.162 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803789 1-163208757251' 2026-02-17T08:36:54.162 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:36:54.162 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:36:54.236 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411338 2026-02-17T08:36:54.236 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411338 2026-02-17T08:36:54.236 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803789 1-163208757251 2-77309411338' 2026-02-17T08:36:54.236 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:36:54.236 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:36:54.313 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=115964116999 2026-02-17T08:36:54.313 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 115964116999 2026-02-17T08:36:54.313 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803789 1-163208757251 2-77309411338 3-115964116999' 2026-02-17T08:36:54.314 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:36:54.314 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803789 2026-02-17T08:36:54.314 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:36:54.315 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:36:54.316 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803789 2026-02-17T08:36:54.316 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:36:54.317 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803789 2026-02-17T08:36:54.317 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803789' 2026-02-17T08:36:54.317 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.0 seq 25769803789 2026-02-17T08:36:54.318 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:36:54.520 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803789 -lt 25769803789 2026-02-17T08:36:54.521 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:36:54.521 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-163208757251 2026-02-17T08:36:54.522 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:36:54.522 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:36:54.523 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-163208757251 2026-02-17T08:36:54.524 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:36:54.525 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=163208757251 2026-02-17T08:36:54.525 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 163208757251' 2026-02-17T08:36:54.525 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.1 seq 163208757251 2026-02-17T08:36:54.526 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:36:54.733 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 1 -lt 163208757251 2026-02-17T08:36:54.733 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:36:55.734 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:36:55.735 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:36:55.933 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 1 -lt 163208757251 2026-02-17T08:36:55.933 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:36:56.934 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T08:36:56.934 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:36:57.130 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 163208757251 -lt 163208757251 2026-02-17T08:36:57.130 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:36:57.130 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-77309411338 2026-02-17T08:36:57.131 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:36:57.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:36:57.132 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-77309411338 2026-02-17T08:36:57.132 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:36:57.134 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411338 2026-02-17T08:36:57.134 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 77309411338' 2026-02-17T08:36:57.134 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.2 seq 77309411338 2026-02-17T08:36:57.134 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:36:57.344 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411339 -lt 77309411338 2026-02-17T08:36:57.344 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:36:57.345 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-115964116999 2026-02-17T08:36:57.345 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:36:57.346 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:36:57.347 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-115964116999 2026-02-17T08:36:57.347 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:36:57.348 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=115964116999 2026-02-17T08:36:57.349 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 115964116999' 2026-02-17T08:36:57.349 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.3 seq 115964116999 2026-02-17T08:36:57.349 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:36:57.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 115964117000 -lt 115964116999 2026-02-17T08:36:57.554 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:36:57.554 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:36:57.555 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:36:57.815 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:36:57.815 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:36:57.816 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:36:57.816 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:36:57.816 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:36:57.816 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:36:57.816 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:36:57.816 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:36:58.007 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:36:58.007 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:36:58.007 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:36:58.007 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:36:58.260 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:36:58.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:36:58.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:36:58.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:161: rados_put_get_data: rados_get td/test-erasure-eio pool-jerasure obj-remove-70936-1 2026-02-17T08:36:58.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:36:58.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:36:58.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-remove-70936-1 2026-02-17T08:36:58.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-17T08:36:58.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-17T08:36:58.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-remove-70936-1 td/test-erasure-eio/COPY 2026-02-17T08:36:58.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-17T08:36:58.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-17T08:36:58.282 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:163: rados_put_get_data: '[' '' = recovery ']' 2026-02-17T08:36:58.283 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:181: rados_put_get_data: expr 1 + 1 2026-02-17T08:36:58.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:181: rados_put_get_data: shard_id=2 2026-02-17T08:36:58.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:182: rados_put_get_data: inject_remove ec data pool-jerasure obj-remove-70936-1 td/test-erasure-eio 2 2026-02-17T08:36:58.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:127: inject_remove: local pooltype=ec 2026-02-17T08:36:58.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:128: inject_remove: shift 2026-02-17T08:36:58.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:129: inject_remove: local which=data 2026-02-17T08:36:58.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:130: inject_remove: shift 2026-02-17T08:36:58.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:131: inject_remove: local poolname=pool-jerasure 2026-02-17T08:36:58.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:132: inject_remove: shift 2026-02-17T08:36:58.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:133: inject_remove: local objname=obj-remove-70936-1 2026-02-17T08:36:58.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:134: inject_remove: shift 2026-02-17T08:36:58.286 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:135: inject_remove: local dir=td/test-erasure-eio 2026-02-17T08:36:58.286 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:136: inject_remove: shift 2026-02-17T08:36:58.286 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:137: inject_remove: local shard_id=2 2026-02-17T08:36:58.286 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:138: inject_remove: shift 2026-02-17T08:36:58.286 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:140: inject_remove: get_osds pool-jerasure obj-remove-70936-1 2026-02-17T08:36:58.286 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:36:58.286 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj-remove-70936-1 2026-02-17T08:36:58.287 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj-remove-70936-1 2026-02-17T08:36:58.287 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:36:58.483 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:36:58.484 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:36:58.484 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:36:58.484 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 2 2026-02-17T08:36:58.484 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:140: inject_remove: initial_osds=('3' '1' '2') 2026-02-17T08:36:58.484 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:140: inject_remove: local -a initial_osds 2026-02-17T08:36:58.484 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:141: inject_remove: local osd_id=2 2026-02-17T08:36:58.484 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:142: inject_remove: objectstore_tool td/test-erasure-eio 2 obj-remove-70936-1 remove 2026-02-17T08:36:58.484 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1297: objectstore_tool: local dir=td/test-erasure-eio 2026-02-17T08:36:58.484 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1298: objectstore_tool: shift 2026-02-17T08:36:58.485 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1299: objectstore_tool: local id=2 2026-02-17T08:36:58.485 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: objectstore_tool: shift 2026-02-17T08:36:58.485 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: objectstore_tool: _objectstore_tool_nowait td/test-erasure-eio 2 obj-remove-70936-1 remove 2026-02-17T08:36:58.485 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1269: _objectstore_tool_nowait: local dir=td/test-erasure-eio 2026-02-17T08:36:58.485 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1270: _objectstore_tool_nowait: shift 2026-02-17T08:36:58.485 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1271: _objectstore_tool_nowait: local id=2 2026-02-17T08:36:58.485 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: _objectstore_tool_nowait: shift 2026-02-17T08:36:58.485 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: _objectstore_tool_nowait: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-17T08:36:58.485 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:36:58.485 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:36:58.485 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:36:58.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:36:58.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:36:59.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:36:59.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1276: _objectstore_tool_nowait: _objectstore_tool_nodown td/test-erasure-eio 2 obj-remove-70936-1 remove 2026-02-17T08:36:59.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/test-erasure-eio 2026-02-17T08:36:59.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T08:36:59.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=2 2026-02-17T08:36:59.794 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T08:36:59.795 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/test-erasure-eio/2 2026-02-17T08:36:59.795 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/test-erasure-eio/2 obj-remove-70936-1 remove 2026-02-17T08:37:00.454 INFO:tasks.workunit.client.0.trial059.stdout:remove 2#2:18cbea2a:::obj-remove-70936-1:head# 2026-02-17T08:37:00.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: _objectstore_tool_nowait: activate_osd td/test-erasure-eio 2 2026-02-17T08:37:00.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-eio 2026-02-17T08:37:00.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:37:00.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=2 2026-02-17T08:37:00.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:37:00.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-17T08:37:00.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:37:00.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:37:00.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:37:00.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:37:00.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-17T08:37:00.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-17T08:37:00.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:37:00.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:37:00.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:37:00.992 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:37:00.993 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:37:00.993 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:37:00.993 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:37:00.993 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:37:00.993 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:37:00.993 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:37:00.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:37:00.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:37:00.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:37:00.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:37:00.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:37:00.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:37:00.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:37:00.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:37:00.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:37:00.995 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:37:00.996 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-17T08:37:00.996 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.2 2026-02-17T08:37:00.996 INFO:tasks.workunit.client.0.trial059.stderr:start osd.2 2026-02-17T08:37:00.996 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:37:00.996 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-17T08:37:00.996 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 2 = 2 ']' 2026-02-17T08:37:00.997 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:37:00.997 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:37:00.997 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:37:01.016 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:01.004+0000 7f685cf098c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:01.018 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:01.004+0000 7f685cf098c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:01.019 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:01.008+0000 7f685cf098c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:01.193 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 2 2026-02-17T08:37:01.193 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:37:01.194 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:37:01.194 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:37:01.194 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:37:01.194 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:01.194 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:37:01.194 INFO:tasks.workunit.client.0.trial059.stderr:0 2026-02-17T08:37:01.194 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:01.194 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:37:01.385 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:02.386 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:02.387 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:02.387 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:37:02.387 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:37:02.387 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:02.388 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:37:02.492 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:02.480+0000 7f685cf098c0 -1 Falling back to public interface 2026-02-17T08:37:02.581 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:03.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:03.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:03.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:37:03.583 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:37:03.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:03.584 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:37:03.776 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:04.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:04.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:04.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:37:04.779 INFO:tasks.workunit.client.0.trial059.stderr:3 2026-02-17T08:37:04.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:04.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:37:04.973 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:05.501 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:05.489+0000 7f685cf098c0 -1 osd.2 40 log_to_monitors true 2026-02-17T08:37:05.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:05.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:05.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:37:05.975 INFO:tasks.workunit.client.0.trial059.stderr:4 2026-02-17T08:37:05.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:05.975 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:37:06.168 INFO:tasks.workunit.client.0.trial059.stderr:osd.2 up in weight 1 up_from 44 up_thru 35 down_at 41 last_clean_interval [18,40) [v2:127.0.0.1:6818/1422803428,v1:127.0.0.1:6819/1422803428] [v2:127.0.0.1:6820/1422803428,v1:127.0.0.1:6821/1422803428] exists,up 632e74eb-4441-4dd8-9e1c-a9485fc279c8 2026-02-17T08:37:06.168 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:37:06.168 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:37:06.168 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:37:06.168 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: objectstore_tool: wait_for_clean 2026-02-17T08:37:06.168 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:37:06.168 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:37:06.169 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:37:06.169 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:37:06.170 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:37:06.170 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:37:06.170 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:37:06.170 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:37:06.170 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:37:06.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:37:06.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:37:06.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:37:06.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:37:06.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:37:06.281 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:37:06.475 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:37:06.475 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:37:06.476 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:37:06.476 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:37:06.476 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:37:06.476 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:37:06.476 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:37:06.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803793 2026-02-17T08:37:06.553 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803793 2026-02-17T08:37:06.554 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793' 2026-02-17T08:37:06.554 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:37:06.554 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:37:06.631 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=163208757255 2026-02-17T08:37:06.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 163208757255 2026-02-17T08:37:06.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-163208757255' 2026-02-17T08:37:06.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:37:06.632 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:37:06.705 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=188978561027 2026-02-17T08:37:06.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 188978561027 2026-02-17T08:37:06.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-163208757255 2-188978561027' 2026-02-17T08:37:06.706 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:37:06.706 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:37:06.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=115964117004 2026-02-17T08:37:06.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 115964117004 2026-02-17T08:37:06.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803793 1-163208757255 2-188978561027 3-115964117004' 2026-02-17T08:37:06.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:37:06.782 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803793 2026-02-17T08:37:06.782 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:37:06.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:37:06.784 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803793 2026-02-17T08:37:06.784 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:37:06.785 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803793 2026-02-17T08:37:06.785 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803793' 2026-02-17T08:37:06.785 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.0 seq 25769803793 2026-02-17T08:37:06.786 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:37:06.990 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803791 -lt 25769803793 2026-02-17T08:37:06.991 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:37:07.992 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:37:07.993 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:37:08.193 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803793 -lt 25769803793 2026-02-17T08:37:08.193 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:37:08.193 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-163208757255 2026-02-17T08:37:08.194 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:37:08.195 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:37:08.196 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-163208757255 2026-02-17T08:37:08.196 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:37:08.197 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=163208757255 2026-02-17T08:37:08.197 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 163208757255' 2026-02-17T08:37:08.197 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.1 seq 163208757255 2026-02-17T08:37:08.198 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:37:08.406 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 163208757256 -lt 163208757255 2026-02-17T08:37:08.406 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:37:08.407 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-188978561027 2026-02-17T08:37:08.407 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:37:08.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:37:08.409 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-188978561027 2026-02-17T08:37:08.409 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:37:08.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=188978561027 2026-02-17T08:37:08.411 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 188978561027' 2026-02-17T08:37:08.411 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.2 seq 188978561027 2026-02-17T08:37:08.411 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:37:08.612 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 188978561027 -lt 188978561027 2026-02-17T08:37:08.613 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:37:08.613 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-115964117004 2026-02-17T08:37:08.613 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:37:08.614 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:37:08.615 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-115964117004 2026-02-17T08:37:08.616 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:37:08.617 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=115964117004 2026-02-17T08:37:08.617 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 115964117004' 2026-02-17T08:37:08.617 INFO:tasks.workunit.client.0.trial059.stderr:waiting osd.3 seq 115964117004 2026-02-17T08:37:08.617 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:37:08.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 115964117004 -lt 115964117004 2026-02-17T08:37:08.824 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:37:08.825 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:37:08.825 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:37:09.086 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:37:09.086 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:37:09.086 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:37:09.086 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:37:09.086 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:37:09.086 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:37:09.086 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:37:09.086 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:37:09.273 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:37:09.274 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:37:09.274 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:37:09.275 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:37:09.524 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:37:09.525 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:37:09.525 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:37:09.525 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:183: rados_put_get_data: rados_get td/test-erasure-eio pool-jerasure obj-remove-70936-1 fail 2026-02-17T08:37:09.525 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:37:09.525 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:37:09.525 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-remove-70936-1 2026-02-17T08:37:09.525 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=fail 2026-02-17T08:37:09.525 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' fail = fail ']' 2026-02-17T08:37:09.525 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:114: rados_get: rados --pool pool-jerasure get obj-remove-70936-1 td/test-erasure-eio/COPY 2026-02-17T08:37:09.542 INFO:tasks.workunit.client.0.trial059.stderr:error getting pool-jerasure/obj-remove-70936-1: (5) Input/output error 2026-02-17T08:37:09.544 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:115: rados_get: return 2026-02-17T08:37:09.544 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:184: rados_put_get_data: rm td/test-erasure-eio/ORIGINAL 2026-02-17T08:37:09.545 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:290: TEST_rados_get_subread_missing: delete_erasure_coded_pool pool-jerasure 2026-02-17T08:37:09.545 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:37:09.545 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-17T08:37:09.739 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' does not exist 2026-02-17T08:37:09.749 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-17T08:37:10.046 INFO:tasks.workunit.client.0.trial059.stderr:erasure-code-profile myprofile does not exist 2026-02-17T08:37:10.055 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-17T08:37:10.055 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:37:10.055 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:37:10.056 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:37:10.056 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:37:10.056 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:37:10.057 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:37:10.057 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:37:10.057 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:37:10.367 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:37:10.367 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:37:10.368 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:37:10.369 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:37:10.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:37:10.371 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:37:10.371 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:37:10.373 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:37:10.373 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:37:10.373 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:37:10.374 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:37:10.375 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:37:10.376 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:37:10.376 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:37:10.392 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:37:10.392 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:37:10.392 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:37:10.392 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:37:10.394 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:37:10.394 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:37:10.394 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-17T08:37:10.394 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-17T08:37:10.394 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-eio 2026-02-17T08:37:10.394 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-eio 2026-02-17T08:37:10.394 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:37:10.395 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:37:10.395 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:37:10.395 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:37:10.395 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:37:10.395 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:37:10.395 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:37:10.395 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:37:10.397 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:37:10.397 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:37:10.398 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:37:10.399 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:37:10.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:37:10.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:37:10.401 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:37:10.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:37:10.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:37:10.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:37:10.403 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:37:10.404 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:37:10.405 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:37:10.405 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:37:10.407 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:37:10.407 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:37:10.407 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:37:10.407 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:37:10.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:37:10.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:37:10.408 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-eio 2026-02-17T08:37:10.410 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:37:10.410 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:37:10.410 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:37:10.410 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.70936 2026-02-17T08:37:10.412 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:37:10.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:37:10.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:37:10.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-17T08:37:10.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-17T08:37:10.413 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-eio 2026-02-17T08:37:10.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:37:10.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:37:10.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:37:10.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-eio/a 2026-02-17T08:37:10.414 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-17T08:37:10.435 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:37:10.435 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:37:10.435 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:37:10.435 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:37:10.435 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:37:10.436 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:37:10.436 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:37:10.436 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T08:37:10.466 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:37:10.467 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:37:10.467 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:37:10.467 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:37:10.467 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:37:10.468 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:37:10.469 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:37:10.469 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:37:10.469 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:37:10.469 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:37:10.469 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:37:10.469 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:37:10.469 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:37:10.469 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:37:10.470 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get fsid 2026-02-17T08:37:10.525 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:37:10.525 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:37:10.525 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:37:10.525 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:37:10.525 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:37:10.527 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:37:10.527 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:37:10.527 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:37:10.527 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:37:10.527 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:37:10.527 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:37:10.527 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:37:10.527 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:37:10.527 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get mon_host 2026-02-17T08:37:10.582 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-17T08:37:10.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-eio 2026-02-17T08:37:10.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:37:10.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:37:10.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:37:10.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-eio/x 2026-02-17T08:37:10.583 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:37:10.692 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:37:10.692 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:37:10.692 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:37:10.692 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:37:10.692 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:37:10.693 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:37:10.693 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:37:10.693 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:37:10.694 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:37:10.714 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-17T08:37:10.714 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T08:37:10.819 INFO:tasks.workunit.client.0.trial059.stderr:pool 'rbd' already exists 2026-02-17T08:37:10.827 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:37:11.830 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-17T08:37:11.831 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:37:11.831 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:37:11.831 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:37:11.831 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:37:11.832 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:37:11.832 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:37:11.832 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-17T08:37:11.832 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-mon.a.asok log flush 2026-02-17T08:37:11.879 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:37:11.884 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-17T08:37:11.886 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:37:10.445+0000 7f4b14b39ec0 0 load: jerasure load: lrc 2026-02-17T08:37:11.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_rados_get_with_subreadall_eio_shard_0 td/test-erasure-eio 2026-02-17T08:37:11.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:330: TEST_rados_get_with_subreadall_eio_shard_0: local dir=td/test-erasure-eio 2026-02-17T08:37:11.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:331: TEST_rados_get_with_subreadall_eio_shard_0: local shard_id=0 2026-02-17T08:37:11.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:333: TEST_rados_get_with_subreadall_eio_shard_0: setup_osds 4 2026-02-17T08:37:11.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=4 2026-02-17T08:37:11.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-17T08:37:11.887 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 4 - 1 2026-02-17T08:37:11.888 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 3 2026-02-17T08:37:11.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:37:11.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-17T08:37:11.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:37:11.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:37:11.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:37:11.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:37:11.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-17T08:37:11.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:37:11.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:37:11.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:37:11.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:37:11.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-17T08:37:11.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-17T08:37:11.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:37:11.890 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:37:11.891 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:37:11.891 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:37:11.891 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:37:11.891 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:37:11.892 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:37:11.892 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:37:11.892 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:37:11.892 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:37:11.892 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:37:11.892 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:37:11.893 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:37:11.893 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:37:11.893 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:37:11.893 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:37:11.893 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:37:11.893 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:37:11.893 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:37:11.893 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:37:11.893 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:37:11.893 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:37:11.893 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-17T08:37:11.893 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:37:11.894 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=203b21be-d310-4e2c-a1a5-7e536f769b4d 2026-02-17T08:37:11.894 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 203b21be-d310-4e2c-a1a5-7e536f769b4d' 2026-02-17T08:37:11.894 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 203b21be-d310-4e2c-a1a5-7e536f769b4d 2026-02-17T08:37:11.894 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:37:11.903 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQC3KJRpoQpMNRAAVyxAaQZNfX5F7j9cJT2yug== 2026-02-17T08:37:11.903 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQC3KJRpoQpMNRAAVyxAaQZNfX5F7j9cJT2yug=="}' 2026-02-17T08:37:11.903 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 203b21be-d310-4e2c-a1a5-7e536f769b4d -i td/test-erasure-eio/0/new.json 2026-02-17T08:37:12.017 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:37:12.024 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-17T08:37:12.026 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC3KJRpoQpMNRAAVyxAaQZNfX5F7j9cJT2yug== --osd-uuid 203b21be-d310-4e2c-a1a5-7e536f769b4d 2026-02-17T08:37:12.041 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:12.029+0000 7fc0508a18c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:12.042 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:12.029+0000 7fc0508a18c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:12.043 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:12.033+0000 7fc0508a18c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:12.044 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:12.033+0000 7fc0508a18c0 -1 bdev(0x564ae2519c00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:37:12.044 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:12.033+0000 7fc0508a18c0 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-17T08:37:14.595 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-17T08:37:14.595 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:37:14.597 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:37:14.597 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:37:14.597 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:37:14.868 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:37:14.869 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:37:14.869 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:37:14.869 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:37:14.869 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:37:14.870 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:37:14.891 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:14.881+0000 7f6615a2e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:14.892 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:14.881+0000 7f6615a2e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:14.893 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:14.881+0000 7f6615a2e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:15.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:37:15.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:37:15.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:37:15.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:37:15.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:37:15.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:15.073 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:37:15.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:37:15.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:15.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:37:15.282 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:16.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:16.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:16.284 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:37:16.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:37:16.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:16.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:37:16.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:16.608 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:16.597+0000 7f6615a2e8c0 -1 Falling back to public interface 2026-02-17T08:37:17.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:17.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:17.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:37:17.481 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:37:17.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:17.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:37:17.683 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:18.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:18.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:18.684 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:37:18.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:37:18.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:18.685 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:37:18.884 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:19.590 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:19.577+0000 7f6615a2e8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:37:19.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:19.886 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:19.886 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:37:19.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:37:19.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:19.887 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:37:20.085 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:21.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:21.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:21.088 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:37:21.088 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:37:21.088 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:21.088 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:37:21.283 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1648687398,v1:127.0.0.1:6803/1648687398] [v2:127.0.0.1:6804/1648687398,v1:127.0.0.1:6805/1648687398] exists,up 203b21be-d310-4e2c-a1a5-7e536f769b4d 2026-02-17T08:37:21.286 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:37:21.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:37:21.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:37:21.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:37:21.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-17T08:37:21.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:37:21.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:37:21.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T08:37:21.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:37:21.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-17T08:37:21.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:37:21.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:37:21.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:37:21.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:37:21.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-17T08:37:21.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-17T08:37:21.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:37:21.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:37:21.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:37:21.288 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:37:21.288 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:37:21.289 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:37:21.289 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:37:21.289 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:37:21.289 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:37:21.289 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:37:21.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:37:21.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:37:21.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:37:21.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:37:21.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:37:21.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:37:21.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:37:21.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:37:21.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:37:21.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:37:21.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:37:21.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:37:21.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-17T08:37:21.290 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:37:21.291 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=b7332bc8-306b-445e-9272-80fa1a5bd495 2026-02-17T08:37:21.291 INFO:tasks.workunit.client.0.trial059.stdout:add osd1 b7332bc8-306b-445e-9272-80fa1a5bd495 2026-02-17T08:37:21.291 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 b7332bc8-306b-445e-9272-80fa1a5bd495' 2026-02-17T08:37:21.292 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:37:21.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDBKJRpgrpXERAAYfG4KvOoOQmmlV3fbNC4GA== 2026-02-17T08:37:21.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDBKJRpgrpXERAAYfG4KvOoOQmmlV3fbNC4GA=="}' 2026-02-17T08:37:21.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new b7332bc8-306b-445e-9272-80fa1a5bd495 -i td/test-erasure-eio/1/new.json 2026-02-17T08:37:21.506 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:37:21.515 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-17T08:37:21.516 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDBKJRpgrpXERAAYfG4KvOoOQmmlV3fbNC4GA== --osd-uuid b7332bc8-306b-445e-9272-80fa1a5bd495 2026-02-17T08:37:21.531 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:21.521+0000 7f2b78e298c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:21.532 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:21.521+0000 7f2b78e298c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:21.534 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:21.521+0000 7f2b78e298c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:21.534 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:21.525+0000 7f2b78e298c0 -1 bdev(0x5650d31a9c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-17T08:37:21.534 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:21.525+0000 7f2b78e298c0 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-17T08:37:23.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-17T08:37:23.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:37:23.812 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T08:37:23.812 INFO:tasks.workunit.client.0.trial059.stdout:adding osd1 key to auth repository 2026-02-17T08:37:23.812 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:37:24.076 INFO:tasks.workunit.client.0.trial059.stdout:start osd.1 2026-02-17T08:37:24.077 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T08:37:24.077 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:37:24.077 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:37:24.078 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:37:24.078 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:37:24.099 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:24.089+0000 7fbfcf7ef8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:24.101 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:24.089+0000 7fbfcf7ef8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:24.102 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:24.089+0000 7fbfcf7ef8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:24.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T08:37:24.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:37:24.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:37:24.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:37:24.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:37:24.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:24.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:37:24.281 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:37:24.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:24.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:37:24.477 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:25.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:25.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:25.479 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:37:25.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:37:25.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:25.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:37:25.644 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:25.633+0000 7fbfcf7ef8c0 -1 Falling back to public interface 2026-02-17T08:37:25.676 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:26.677 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:26.677 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:26.677 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:37:26.678 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:37:26.678 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:26.678 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:37:26.874 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:27.875 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:27.875 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:27.876 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:37:27.876 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:37:27.876 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:27.877 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:37:28.071 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:28.683 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:28.673+0000 7fbfcf7ef8c0 -1 osd.1 0 log_to_monitors true 2026-02-17T08:37:29.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:29.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:29.073 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:37:29.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:37:29.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:29.074 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:37:29.275 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:30.277 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:30.277 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:30.277 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:37:30.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:37:30.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:30.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:37:30.474 INFO:tasks.workunit.client.0.trial059.stdout:osd.1 up in weight 1 up_from 13 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4200785570,v1:127.0.0.1:6811/4200785570] [v2:127.0.0.1:6812/4200785570,v1:127.0.0.1:6813/4200785570] exists,up b7332bc8-306b-445e-9272-80fa1a5bd495 2026-02-17T08:37:30.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:37:30.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:37:30.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:37:30.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:37:30.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-17T08:37:30.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:37:30.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:37:30.478 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T08:37:30.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:37:30.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-17T08:37:30.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:37:30.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:37:30.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:37:30.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:37:30.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-17T08:37:30.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-17T08:37:30.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:37:30.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:37:30.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:37:30.480 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:37:30.480 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:37:30.480 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:37:30.480 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:37:30.480 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:37:30.480 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:37:30.480 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:37:30.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:37:30.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:37:30.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:37:30.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:37:30.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:37:30.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:37:30.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:37:30.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:37:30.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:37:30.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:37:30.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:37:30.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:37:30.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-17T08:37:30.481 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:37:30.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=61baa0f5-b237-4bea-9064-8104ba8233e0 2026-02-17T08:37:30.482 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 61baa0f5-b237-4bea-9064-8104ba8233e0' 2026-02-17T08:37:30.483 INFO:tasks.workunit.client.0.trial059.stdout:add osd2 61baa0f5-b237-4bea-9064-8104ba8233e0 2026-02-17T08:37:30.483 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:37:30.491 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDKKJRpMqe8HBAAMobkyngO/bocRQnl8K/y0w== 2026-02-17T08:37:30.492 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDKKJRpMqe8HBAAMobkyngO/bocRQnl8K/y0w=="}' 2026-02-17T08:37:30.492 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 61baa0f5-b237-4bea-9064-8104ba8233e0 -i td/test-erasure-eio/2/new.json 2026-02-17T08:37:30.700 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:37:30.710 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-17T08:37:30.711 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDKKJRpMqe8HBAAMobkyngO/bocRQnl8K/y0w== --osd-uuid 61baa0f5-b237-4bea-9064-8104ba8233e0 2026-02-17T08:37:30.727 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:30.717+0000 7f015414b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:30.728 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:30.717+0000 7f015414b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:30.730 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:30.717+0000 7f015414b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:30.730 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:30.717+0000 7f015414b8c0 -1 bdev(0x5568fb22dc00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-17T08:37:30.730 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:30.721+0000 7f015414b8c0 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-17T08:37:33.000 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-17T08:37:33.000 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:37:33.001 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T08:37:33.001 INFO:tasks.workunit.client.0.trial059.stdout:adding osd2 key to auth repository 2026-02-17T08:37:33.002 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:37:33.276 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T08:37:33.277 INFO:tasks.workunit.client.0.trial059.stdout:start osd.2 2026-02-17T08:37:33.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:37:33.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:37:33.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:37:33.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:37:33.300 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:33.289+0000 7fa42725c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:33.301 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:33.289+0000 7fa42725c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:33.302 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:33.293+0000 7fa42725c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:33.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T08:37:33.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:37:33.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:37:33.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:37:33.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:37:33.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:33.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:37:33.480 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:37:33.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:33.481 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:37:33.679 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:34.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:34.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:34.681 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:37:34.682 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:37:34.682 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:34.682 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:37:34.879 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:35.020 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:35.009+0000 7fa42725c8c0 -1 Falling back to public interface 2026-02-17T08:37:35.880 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:35.880 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:35.881 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:37:35.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:37:35.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:35.881 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:37:36.078 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:37.079 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:37.079 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:37.080 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:37:37.080 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:37:37.081 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:37.081 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:37:37.275 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:38.055 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:38.045+0000 7fa42725c8c0 -1 osd.2 0 log_to_monitors true 2026-02-17T08:37:38.277 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:38.277 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:38.277 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:37:38.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:37:38.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:38.278 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:37:38.489 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:39.491 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:39.491 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:39.491 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:37:39.491 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:37:39.492 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:39.492 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:37:39.695 INFO:tasks.workunit.client.0.trial059.stdout:osd.2 up in weight 1 up_from 19 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1543834345,v1:127.0.0.1:6819/1543834345] [v2:127.0.0.1:6820/1543834345,v1:127.0.0.1:6821/1543834345] exists,up 61baa0f5-b237-4bea-9064-8104ba8233e0 2026-02-17T08:37:39.699 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:37:39.699 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:37:39.699 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:37:39.699 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:37:39.699 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-17T08:37:39.699 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:37:39.699 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:37:39.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2026-02-17T08:37:39.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:37:39.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-17T08:37:39.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:37:39.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:37:39.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:37:39.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:37:39.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-17T08:37:39.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-17T08:37:39.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:37:39.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:37:39.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:37:39.700 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:37:39.701 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:37:39.701 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:37:39.701 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:37:39.701 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:37:39.701 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:37:39.701 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:37:39.701 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:37:39.701 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:37:39.701 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:37:39.701 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:37:39.701 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:37:39.701 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:37:39.702 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:37:39.702 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:37:39.702 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:37:39.702 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:37:39.702 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:37:39.702 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:37:39.702 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-17T08:37:39.703 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:37:39.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=afb71ece-3eaf-4e8a-ab2a-c4761250218e 2026-02-17T08:37:39.703 INFO:tasks.workunit.client.0.trial059.stdout:add osd3 afb71ece-3eaf-4e8a-ab2a-c4761250218e 2026-02-17T08:37:39.704 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 afb71ece-3eaf-4e8a-ab2a-c4761250218e' 2026-02-17T08:37:39.704 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:37:39.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDTKJRpKDz2KRAAiqPkUAWuZS3B8OguMFctlQ== 2026-02-17T08:37:39.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDTKJRpKDz2KRAAiqPkUAWuZS3B8OguMFctlQ=="}' 2026-02-17T08:37:39.713 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new afb71ece-3eaf-4e8a-ab2a-c4761250218e -i td/test-erasure-eio/3/new.json 2026-02-17T08:37:39.908 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:37:39.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-17T08:37:39.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDTKJRpKDz2KRAAiqPkUAWuZS3B8OguMFctlQ== --osd-uuid afb71ece-3eaf-4e8a-ab2a-c4761250218e 2026-02-17T08:37:39.940 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:39.929+0000 7f315dfab8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:39.942 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:39.929+0000 7f315dfab8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:39.943 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:39.933+0000 7f315dfab8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:39.943 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:39.933+0000 7f315dfab8c0 -1 bdev(0x55d71b789c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-17T08:37:39.944 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:39.933+0000 7f315dfab8c0 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-17T08:37:42.228 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-17T08:37:42.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:37:42.229 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2026-02-17T08:37:42.230 INFO:tasks.workunit.client.0.trial059.stdout:adding osd3 key to auth repository 2026-02-17T08:37:42.230 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:37:42.500 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2026-02-17T08:37:42.501 INFO:tasks.workunit.client.0.trial059.stdout:start osd.3 2026-02-17T08:37:42.501 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:37:42.501 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:37:42.501 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:37:42.501 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:37:42.523 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:42.513+0000 7ff6cdd798c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:42.525 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:42.513+0000 7ff6cdd798c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:42.527 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:42.517+0000 7ff6cdd798c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:42.695 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2026-02-17T08:37:42.695 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:37:42.695 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T08:37:42.695 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:37:42.695 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:37:42.695 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:42.695 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:37:42.695 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:37:42.695 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:42.695 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:37:42.897 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:43.898 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:43.898 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:43.898 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:37:43.898 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:37:43.898 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:43.898 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:37:44.097 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:44.480 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:44.469+0000 7ff6cdd798c0 -1 Falling back to public interface 2026-02-17T08:37:45.099 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:45.099 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:45.099 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:37:45.099 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:37:45.099 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:45.099 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:37:45.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:46.299 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:46.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:46.300 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:37:46.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:37:46.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:46.301 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:37:46.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:47.461 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:47.449+0000 7ff6cdd798c0 -1 osd.3 0 log_to_monitors true 2026-02-17T08:37:47.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:47.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:47.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:37:47.500 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:37:47.500 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:47.500 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:37:47.700 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:48.701 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:48.701 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:48.702 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:37:48.702 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:37:48.702 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:48.703 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:37:48.901 INFO:tasks.workunit.client.0.trial059.stdout:osd.3 up in weight 1 up_from 26 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2112452083,v1:127.0.0.1:6827/2112452083] [v2:127.0.0.1:6828/2112452083,v1:127.0.0.1:6829/2112452083] exists,up afb71ece-3eaf-4e8a-ab2a-c4761250218e 2026-02-17T08:37:48.901 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:37:48.901 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:37:48.901 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:37:48.902 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-17T08:37:48.902 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:37:48.902 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:37:48.902 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:37:48.902 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:37:48.902 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:37:48.903 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.0.asok 2026-02-17T08:37:48.903 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-17T08:37:48.903 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.0.asok log flush 2026-02-17T08:37:48.957 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:37:48.962 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-17T08:37:48.964 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:37:16.601+0000 7f6615a2e8c0 0 load: jerasure load: lrc 2026-02-17T08:37:48.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:335: TEST_rados_get_with_subreadall_eio_shard_0: local poolname=pool-jerasure 2026-02-17T08:37:48.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:336: TEST_rados_get_with_subreadall_eio_shard_0: create_erasure_coded_pool pool-jerasure 2 1 2026-02-17T08:37:48.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:37:48.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-17T08:37:48.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=2 2026-02-17T08:37:48.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-17T08:37:48.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=1 2026-02-17T08:37:48.965 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-17T08:37:48.966 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=2 m=1 crush-failure-domain=osd 2026-02-17T08:37:49.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-17T08:37:49.227 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-17T08:37:49.621 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' already exists 2026-02-17T08:37:49.630 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:37:50.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-17T08:37:50.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:37:50.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:37:50.632 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:37:50.633 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:37:50.633 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:37:50.633 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:37:50.634 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:37:50.634 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:37:50.634 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:37:50.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:37:50.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:37:50.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:37:50.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:37:50.744 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:37:50.744 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:37:50.945 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:37:50.945 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:37:50.945 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:37:50.945 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:37:50.945 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:37:50.945 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:37:50.945 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:37:51.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803785 2026-02-17T08:37:51.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803785 2026-02-17T08:37:51.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803785' 2026-02-17T08:37:51.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:37:51.021 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:37:51.095 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=55834574855 2026-02-17T08:37:51.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 55834574855 2026-02-17T08:37:51.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803785 1-55834574855' 2026-02-17T08:37:51.096 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:37:51.096 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:37:51.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=81604378629 2026-02-17T08:37:51.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 81604378629 2026-02-17T08:37:51.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803785 1-55834574855 2-81604378629' 2026-02-17T08:37:51.172 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:37:51.172 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:37:51.248 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=111669149699 2026-02-17T08:37:51.248 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 111669149699 2026-02-17T08:37:51.248 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803785 1-55834574855 2-81604378629 3-111669149699' 2026-02-17T08:37:51.248 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:37:51.249 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803785 2026-02-17T08:37:51.249 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:37:51.249 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:37:51.250 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803785 2026-02-17T08:37:51.250 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:37:51.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803785 2026-02-17T08:37:51.252 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803785' 2026-02-17T08:37:51.252 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 25769803785 2026-02-17T08:37:51.253 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:37:51.460 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803783 -lt 25769803785 2026-02-17T08:37:51.460 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:37:52.461 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:37:52.461 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:37:52.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803783 -lt 25769803785 2026-02-17T08:37:52.657 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:37:53.658 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T08:37:53.658 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:37:53.859 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803785 -lt 25769803785 2026-02-17T08:37:53.859 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:37:53.860 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-55834574855 2026-02-17T08:37:53.860 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:37:53.861 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:37:53.862 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-55834574855 2026-02-17T08:37:53.862 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:37:53.863 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=55834574855 2026-02-17T08:37:53.863 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 55834574855' 2026-02-17T08:37:53.864 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 55834574855 2026-02-17T08:37:53.864 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:37:54.068 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 55834574855 -lt 55834574855 2026-02-17T08:37:54.068 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:37:54.069 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-81604378629 2026-02-17T08:37:54.069 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:37:54.069 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:37:54.070 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-81604378629 2026-02-17T08:37:54.070 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:37:54.072 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=81604378629 2026-02-17T08:37:54.072 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 81604378629 2026-02-17T08:37:54.073 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 81604378629' 2026-02-17T08:37:54.073 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:37:54.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 81604378629 -lt 81604378629 2026-02-17T08:37:54.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:37:54.286 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-111669149699 2026-02-17T08:37:54.286 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:37:54.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:37:54.288 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-111669149699 2026-02-17T08:37:54.288 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:37:54.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=111669149699 2026-02-17T08:37:54.290 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 111669149699 2026-02-17T08:37:54.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 111669149699' 2026-02-17T08:37:54.290 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:37:54.501 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 111669149699 -lt 111669149699 2026-02-17T08:37:54.501 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:37:54.502 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:37:54.502 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:37:54.763 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:37:54.763 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:37:54.763 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:37:54.763 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:37:54.763 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:37:54.763 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:37:54.764 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:37:54.764 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:37:54.957 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:37:54.958 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:37:54.958 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:37:54.958 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:37:55.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:37:55.218 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:37:55.219 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:37:55.219 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:338: TEST_rados_get_with_subreadall_eio_shard_0: rados_put_get_data eio td/test-erasure-eio 0 recovery 2026-02-17T08:37:55.219 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:147: rados_put_get_data: local inject=eio 2026-02-17T08:37:55.219 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:148: rados_put_get_data: shift 2026-02-17T08:37:55.219 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:149: rados_put_get_data: local dir=td/test-erasure-eio 2026-02-17T08:37:55.219 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:150: rados_put_get_data: shift 2026-02-17T08:37:55.219 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:151: rados_put_get_data: local shard_id=0 2026-02-17T08:37:55.219 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:152: rados_put_get_data: shift 2026-02-17T08:37:55.219 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:153: rados_put_get_data: local arg=recovery 2026-02-17T08:37:55.219 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:157: rados_put_get_data: local poolname=pool-jerasure 2026-02-17T08:37:55.219 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:158: rados_put_get_data: local objname=obj-eio-70936-0 2026-02-17T08:37:55.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:159: rados_put_get_data: rados_put td/test-erasure-eio pool-jerasure obj-eio-70936-0 2026-02-17T08:37:55.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-17T08:37:55.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-17T08:37:55.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-eio-70936-0 2026-02-17T08:37:55.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:37:55.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-17T08:37:55.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:37:55.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-17T08:37:55.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:37:55.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-17T08:37:55.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:37:55.220 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-17T08:37:55.221 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-eio-70936-0 td/test-erasure-eio/ORIGINAL 2026-02-17T08:37:55.237 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:160: rados_put_get_data: inject_eio ec data pool-jerasure obj-eio-70936-0 td/test-erasure-eio 0 2026-02-17T08:37:55.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2457: inject_eio: local pooltype=ec 2026-02-17T08:37:55.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2458: inject_eio: shift 2026-02-17T08:37:55.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2459: inject_eio: local which=data 2026-02-17T08:37:55.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2460: inject_eio: shift 2026-02-17T08:37:55.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2461: inject_eio: local poolname=pool-jerasure 2026-02-17T08:37:55.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2462: inject_eio: shift 2026-02-17T08:37:55.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2463: inject_eio: local objname=obj-eio-70936-0 2026-02-17T08:37:55.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2464: inject_eio: shift 2026-02-17T08:37:55.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2465: inject_eio: local dir=td/test-erasure-eio 2026-02-17T08:37:55.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2466: inject_eio: shift 2026-02-17T08:37:55.238 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2467: inject_eio: local shard_id=0 2026-02-17T08:37:55.239 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2468: inject_eio: shift 2026-02-17T08:37:55.239 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: get_osds pool-jerasure obj-eio-70936-0 2026-02-17T08:37:55.239 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:37:55.239 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj-eio-70936-0 2026-02-17T08:37:55.239 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj-eio-70936-0 2026-02-17T08:37:55.239 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:37:55.433 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:37:55.434 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:37:55.434 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:37:55.434 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 2 2026-02-17T08:37:55.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: initial_osds=('3' '1' '2') 2026-02-17T08:37:55.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: local -a initial_osds 2026-02-17T08:37:55.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2471: inject_eio: local osd_id=3 2026-02-17T08:37:55.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2472: inject_eio: '[' ec '!=' ec ']' 2026-02-17T08:37:55.435 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: cat td/test-erasure-eio/3/type 2026-02-17T08:37:55.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: type=bluestore 2026-02-17T08:37:55.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2476: inject_eio: set_config osd 3 bluestore_debug_inject_read_err true 2026-02-17T08:37:55.436 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1161: set_config: local daemon=osd 2026-02-17T08:37:55.436 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1162: set_config: local id=3 2026-02-17T08:37:55.436 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1163: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T08:37:55.436 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1164: set_config: local value=true 2026-02-17T08:37:55.437 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: jq 'has("success")' 2026-02-17T08:37:55.437 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: get_asok_path osd.3 2026-02-17T08:37:55.437 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2026-02-17T08:37:55.437 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2026-02-17T08:37:55.437 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:37:55.438 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:37:55.438 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:37:55.438 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.3.asok 2026-02-17T08:37:55.438 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.70936/ceph-osd.3.asok config set bluestore_debug_inject_read_err true 2026-02-17T08:37:55.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: test true == true 2026-02-17T08:37:55.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2477: inject_eio: local loop=0 2026-02-17T08:37:55.499 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2479: inject_eio: grep -q Invalid 2026-02-17T08:37:55.499 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: get_asok_path osd.3 2026-02-17T08:37:55.499 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2026-02-17T08:37:55.499 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2026-02-17T08:37:55.500 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:37:55.500 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:37:55.500 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:37:55.500 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.3.asok 2026-02-17T08:37:55.500 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: CEPH_ARGS= 2026-02-17T08:37:55.500 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.3.asok injectdataerr pool-jerasure obj-eio-70936-0 0 2026-02-17T08:37:55.557 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:161: rados_put_get_data: rados_get td/test-erasure-eio pool-jerasure obj-eio-70936-0 2026-02-17T08:37:55.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:37:55.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:37:55.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-eio-70936-0 2026-02-17T08:37:55.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-17T08:37:55.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-17T08:37:55.558 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-eio-70936-0 td/test-erasure-eio/COPY 2026-02-17T08:37:55.578 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-17T08:37:55.579 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-17T08:37:55.580 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:163: rados_put_get_data: '[' recovery = recovery ']' 2026-02-17T08:37:55.581 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:170: rados_put_get_data: get_osds pool-jerasure obj-eio-70936-0 2026-02-17T08:37:55.581 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:37:55.581 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj-eio-70936-0 2026-02-17T08:37:55.582 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj-eio-70936-0 2026-02-17T08:37:55.582 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:37:55.781 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:37:55.781 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:37:55.781 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:37:55.781 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 2 2026-02-17T08:37:55.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:170: rados_put_get_data: initial_osds=('3' '1' '2') 2026-02-17T08:37:55.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:170: rados_put_get_data: local -a initial_osds 2026-02-17T08:37:55.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:171: rados_put_get_data: local last_osd=2 2026-02-17T08:37:55.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:173: rados_put_get_data: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-17T08:37:55.782 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:37:55.782 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:37:55.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:37:55.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:37:55.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:37:57.091 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:37:57.091 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:174: rados_put_get_data: ceph osd out 2 2026-02-17T08:37:57.344 INFO:tasks.workunit.client.0.trial059.stderr:osd.2 is already out. 2026-02-17T08:37:57.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:175: rados_put_get_data: get_osds pool-jerasure obj-eio-70936-0 2026-02-17T08:37:57.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:37:57.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj-eio-70936-0 2026-02-17T08:37:57.354 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:175: rados_put_get_data: grep '\<2\>' 2026-02-17T08:37:57.355 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj-eio-70936-0 2026-02-17T08:37:57.355 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:37:57.562 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:37:57.562 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:37:57.562 INFO:tasks.workunit.client.0.trial059.stderr:0' 2026-02-17T08:37:57.562 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 0 2026-02-17T08:37:57.563 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:176: rados_put_get_data: ceph osd in 2 2026-02-17T08:37:57.812 INFO:tasks.workunit.client.0.trial059.stderr:osd.2 is already in. 2026-02-17T08:37:57.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:177: rados_put_get_data: activate_osd td/test-erasure-eio 2 2026-02-17T08:37:57.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-eio 2026-02-17T08:37:57.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:37:57.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=2 2026-02-17T08:37:57.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:37:57.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-17T08:37:57.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:37:57.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:37:57.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:37:57.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:37:57.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-17T08:37:57.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-17T08:37:57.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:37:57.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:37:57.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:37:57.825 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:37:57.825 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:37:57.825 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:37:57.826 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:37:57.826 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:37:57.826 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:37:57.826 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:37:57.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:37:57.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:37:57.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:37:57.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:37:57.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:37:57.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:37:57.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:37:57.827 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:37:57.827 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:37:57.827 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:37:57.827 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-17T08:37:57.827 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.2 2026-02-17T08:37:57.827 INFO:tasks.workunit.client.0.trial059.stdout:start osd.2 2026-02-17T08:37:57.827 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:37:57.828 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-17T08:37:57.829 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 2 = 2 ']' 2026-02-17T08:37:57.829 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:37:57.830 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:37:57.830 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:37:57.850 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:57.841+0000 7f40b0dcb8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:57.852 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:57.841+0000 7f40b0dcb8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:57.853 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:57.841+0000 7f40b0dcb8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:37:58.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 2 2026-02-17T08:37:58.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:37:58.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:37:58.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:37:58.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:37:58.032 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:58.033 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:37:58.033 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:37:58.033 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:58.034 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:37:58.230 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:37:59.100 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:37:59.089+0000 7f40b0dcb8c0 -1 Falling back to public interface 2026-02-17T08:37:59.231 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:37:59.231 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:37:59.232 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:37:59.233 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:37:59.233 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:37:59.233 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:37:59.424 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:00.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:00.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:00.425 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:38:00.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:38:00.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:00.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:38:00.623 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:01.624 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:01.624 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:01.624 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:38:01.624 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:38:01.624 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:01.625 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:38:01.823 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:02.192 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:02.181+0000 7f40b0dcb8c0 -1 osd.2 33 log_to_monitors true 2026-02-17T08:38:02.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:02.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:02.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:38:02.825 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:38:02.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:02.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:38:03.020 INFO:tasks.workunit.client.0.trial059.stdout:osd.2 up in weight 1 up_from 42 up_thru 19 down_at 34 last_clean_interval [19,33) [v2:127.0.0.1:6818/3661753788,v1:127.0.0.1:6819/3661753788] [v2:127.0.0.1:6820/3661753788,v1:127.0.0.1:6821/3661753788] exists,up 61baa0f5-b237-4bea-9064-8104ba8233e0 2026-02-17T08:38:03.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:38:03.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:38:03.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:38:03.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:178: rados_put_get_data: wait_for_clean 2026-02-17T08:38:03.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:38:03.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:38:03.021 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:38:03.021 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:38:03.021 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:38:03.022 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:38:03.022 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:38:03.022 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:38:03.022 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:38:03.136 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:38:03.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:38:03.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:38:03.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:38:03.137 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:38:03.137 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:38:03.346 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:38:03.347 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:38:03.347 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:38:03.347 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:38:03.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:38:03.347 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:38:03.347 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:38:03.422 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803789 2026-02-17T08:38:03.422 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803789 2026-02-17T08:38:03.422 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803789' 2026-02-17T08:38:03.422 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:38:03.422 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:38:03.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=55834574859 2026-02-17T08:38:03.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 55834574859 2026-02-17T08:38:03.497 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803789 1-55834574859' 2026-02-17T08:38:03.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:38:03.498 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:38:03.571 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=180388626435 2026-02-17T08:38:03.571 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 180388626435 2026-02-17T08:38:03.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803789 1-55834574859 2-180388626435' 2026-02-17T08:38:03.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:38:03.572 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:38:03.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=111669149704 2026-02-17T08:38:03.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 111669149704 2026-02-17T08:38:03.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803789 1-55834574859 2-180388626435 3-111669149704' 2026-02-17T08:38:03.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:38:03.648 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803789 2026-02-17T08:38:03.649 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:38:03.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:38:03.651 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803789 2026-02-17T08:38:03.651 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:38:03.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803789 2026-02-17T08:38:03.653 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 25769803789 2026-02-17T08:38:03.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803789' 2026-02-17T08:38:03.653 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:38:03.857 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803787 -lt 25769803789 2026-02-17T08:38:03.857 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:38:04.858 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:38:04.858 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:38:05.059 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803789 -lt 25769803789 2026-02-17T08:38:05.059 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:38:05.060 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-55834574859 2026-02-17T08:38:05.060 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:38:05.061 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:38:05.062 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-55834574859 2026-02-17T08:38:05.062 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:38:05.064 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=55834574859 2026-02-17T08:38:05.064 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 55834574859 2026-02-17T08:38:05.064 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 55834574859' 2026-02-17T08:38:05.064 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:38:05.267 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 55834574860 -lt 55834574859 2026-02-17T08:38:05.267 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:38:05.267 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-180388626435 2026-02-17T08:38:05.268 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:38:05.269 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:38:05.270 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-180388626435 2026-02-17T08:38:05.270 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:38:05.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=180388626435 2026-02-17T08:38:05.271 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 180388626435 2026-02-17T08:38:05.271 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 180388626435' 2026-02-17T08:38:05.272 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:38:05.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 180388626435 -lt 180388626435 2026-02-17T08:38:05.479 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:38:05.479 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-111669149704 2026-02-17T08:38:05.480 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:38:05.480 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:38:05.481 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-111669149704 2026-02-17T08:38:05.481 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:38:05.483 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=111669149704 2026-02-17T08:38:05.484 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 111669149704 2026-02-17T08:38:05.484 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 111669149704' 2026-02-17T08:38:05.484 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:38:05.682 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 111669149704 -lt 111669149704 2026-02-17T08:38:05.683 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:38:05.684 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:38:05.684 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:38:05.955 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:38:05.955 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:38:05.955 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:38:05.956 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:38:05.956 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:38:05.956 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:38:05.956 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:38:05.956 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:38:06.150 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:38:06.151 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:38:06.151 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:38:06.152 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:38:06.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:38:06.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:38:06.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:38:06.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:340: TEST_rados_get_with_subreadall_eio_shard_0: delete_erasure_coded_pool pool-jerasure 2026-02-17T08:38:06.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:38:06.416 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-17T08:38:06.624 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' does not exist 2026-02-17T08:38:06.633 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-17T08:38:06.931 INFO:tasks.workunit.client.0.trial059.stderr:erasure-code-profile myprofile does not exist 2026-02-17T08:38:06.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-17T08:38:06.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:38:06.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:38:06.940 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:38:06.940 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:38:06.941 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:38:06.941 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:38:06.941 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:38:06.941 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:38:07.253 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:38:07.254 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:38:07.255 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:38:07.256 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:38:07.257 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:38:07.257 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:38:07.258 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:38:07.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:38:07.259 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:38:07.260 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:38:07.260 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:38:07.261 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:38:07.262 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:38:07.263 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:38:07.276 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:38:07.276 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:38:07.276 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:38:07.277 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:38:07.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:38:07.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:38:07.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:32: run: for func in $funcs 2026-02-17T08:38:07.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:33: run: setup td/test-erasure-eio 2026-02-17T08:38:07.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/test-erasure-eio 2026-02-17T08:38:07.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/test-erasure-eio 2026-02-17T08:38:07.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:38:07.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:38:07.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:38:07.280 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:38:07.280 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:38:07.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:38:07.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:38:07.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:38:07.282 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:38:07.282 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:38:07.283 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:38:07.283 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:38:07.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:38:07.285 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:38:07.285 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:38:07.286 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:38:07.286 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:38:07.287 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:38:07.287 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:38:07.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:38:07.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:38:07.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:38:07.291 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:38:07.291 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:38:07.291 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:38:07.291 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:38:07.293 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:38:07.293 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:38:07.293 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/test-erasure-eio 2026-02-17T08:38:07.294 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T08:38:07.294 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:38:07.294 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:38:07.294 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.70936 2026-02-17T08:38:07.296 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T08:38:07.297 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T08:38:07.297 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T08:38:07.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/test-erasure-eio 1' TERM HUP INT 2026-02-17T08:38:07.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:34: run: run_mon td/test-erasure-eio a 2026-02-17T08:38:07.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/test-erasure-eio 2026-02-17T08:38:07.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T08:38:07.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T08:38:07.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T08:38:07.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/test-erasure-eio/a 2026-02-17T08:38:07.298 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/test-erasure-eio/a --run-dir=td/test-erasure-eio 2026-02-17T08:38:07.318 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T08:38:07.318 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:38:07.319 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:38:07.319 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:38:07.319 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:38:07.319 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:38:07.319 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:38:07.320 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/test-erasure-eio/a '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --mon-cluster-log-file=td/test-erasure-eio/log --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T08:38:07.349 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T08:38:07.350 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T08:38:07.350 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:38:07.350 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:38:07.350 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T08:38:07.351 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T08:38:07.351 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:38:07.351 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:38:07.351 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:38:07.351 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:38:07.352 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:38:07.352 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:38:07.352 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:38:07.352 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:38:07.352 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get fsid 2026-02-17T08:38:07.407 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T08:38:07.407 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T08:38:07.407 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T08:38:07.408 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T08:38:07.408 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T08:38:07.410 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T08:38:07.410 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:38:07.410 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:38:07.410 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:38:07.411 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:38:07.411 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:38:07.411 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:38:07.411 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T08:38:07.411 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.70936/ceph-mon.a.asok config get mon_host 2026-02-17T08:38:07.462 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:35: run: run_mgr td/test-erasure-eio x 2026-02-17T08:38:07.462 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/test-erasure-eio 2026-02-17T08:38:07.462 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T08:38:07.462 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T08:38:07.462 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T08:38:07.462 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/test-erasure-eio/x 2026-02-17T08:38:07.462 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T08:38:07.570 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T08:38:07.570 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:38:07.570 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:38:07.570 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:38:07.570 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:38:07.570 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:38:07.570 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:38:07.571 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:38:07.572 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/test-erasure-eio/x '--log-file=td/test-erasure-eio/$name.log' '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --run-dir=td/test-erasure-eio '--pid-file=td/test-erasure-eio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T08:38:07.588 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:36: run: create_pool rbd 4 2026-02-17T08:38:07.589 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2026-02-17T08:38:07.704 INFO:tasks.workunit.client.0.trial059.stderr:pool 'rbd' already exists 2026-02-17T08:38:07.712 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:38:08.714 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: get_asok_path mon.a 2026-02-17T08:38:08.715 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T08:38:08.715 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T08:38:08.715 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:38:08.715 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:38:08.715 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:38:08.715 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-mon.a.asok 2026-02-17T08:38:08.716 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: CEPH_ARGS= 2026-02-17T08:38:08.716 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:39: run: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-mon.a.asok log flush 2026-02-17T08:38:08.765 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:38:08.771 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:40: run: grep 'load: jerasure.*lrc' td/test-erasure-eio/mon.a.log 2026-02-17T08:38:08.773 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:38:07.329+0000 7f281d894ec0 0 load: jerasure load: lrc 2026-02-17T08:38:08.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:41: run: TEST_rados_get_with_subreadall_eio_shard_1 td/test-erasure-eio 2026-02-17T08:38:08.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:344: TEST_rados_get_with_subreadall_eio_shard_1: local dir=td/test-erasure-eio 2026-02-17T08:38:08.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:345: TEST_rados_get_with_subreadall_eio_shard_1: local shard_id=1 2026-02-17T08:38:08.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:347: TEST_rados_get_with_subreadall_eio_shard_1: setup_osds 4 2026-02-17T08:38:08.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:47: setup_osds: local count=4 2026-02-17T08:38:08.774 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:48: setup_osds: shift 2026-02-17T08:38:08.774 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: expr 4 - 1 2026-02-17T08:38:08.775 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: seq 0 3 2026-02-17T08:38:08.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:38:08.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 0 2026-02-17T08:38:08.778 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:38:08.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:38:08.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T08:38:08.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:38:08.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/0 2026-02-17T08:38:08.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:38:08.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:38:08.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:38:08.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:38:08.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/0' 2026-02-17T08:38:08.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/0/journal' 2026-02-17T08:38:08.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:38:08.779 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:38:08.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:38:08.780 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:38:08.780 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:38:08.780 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:38:08.780 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:38:08.780 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:38:08.780 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:38:08.780 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:38:08.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:38:08.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:38:08.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:38:08.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:38:08.780 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:38:08.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:38:08.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:38:08.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:38:08.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:38:08.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:38:08.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:38:08.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:38:08.781 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/0 2026-02-17T08:38:08.782 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:38:08.782 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=33775f28-2d0f-4234-8af8-460814edcb31 2026-02-17T08:38:08.782 INFO:tasks.workunit.client.0.trial059.stdout:add osd0 33775f28-2d0f-4234-8af8-460814edcb31 2026-02-17T08:38:08.783 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 33775f28-2d0f-4234-8af8-460814edcb31' 2026-02-17T08:38:08.783 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:38:08.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQDwKJRp2gOpLhAAiD8k0aJDHDlV+yS4kWIXwA== 2026-02-17T08:38:08.792 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQDwKJRp2gOpLhAAiD8k0aJDHDlV+yS4kWIXwA=="}' 2026-02-17T08:38:08.792 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 33775f28-2d0f-4234-8af8-460814edcb31 -i td/test-erasure-eio/0/new.json 2026-02-17T08:38:08.903 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:38:08.910 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/0/new.json 2026-02-17T08:38:08.912 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDwKJRp2gOpLhAAiD8k0aJDHDlV+yS4kWIXwA== --osd-uuid 33775f28-2d0f-4234-8af8-460814edcb31 2026-02-17T08:38:08.927 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:08.917+0000 7f048ed808c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:08.929 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:08.917+0000 7f048ed808c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:08.930 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:08.921+0000 7f048ed808c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:08.930 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:08.921+0000 7f048ed808c0 -1 bdev(0x55d522fadc00 td/test-erasure-eio/0/block) open stat got: (1) Operation not permitted 2026-02-17T08:38:08.930 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:08.921+0000 7f048ed808c0 -1 bluestore(td/test-erasure-eio/0) _read_fsid unparsable uuid 2026-02-17T08:38:11.462 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/0/keyring 2026-02-17T08:38:11.462 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:38:11.463 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T08:38:11.463 INFO:tasks.workunit.client.0.trial059.stdout:adding osd0 key to auth repository 2026-02-17T08:38:11.464 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:38:11.726 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T08:38:11.727 INFO:tasks.workunit.client.0.trial059.stdout:start osd.0 2026-02-17T08:38:11.728 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/0 --osd-journal=td/test-erasure-eio/0/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:38:11.728 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:38:11.728 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:38:11.728 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:38:11.750 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:11.737+0000 7f3bb29ca8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:11.751 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:11.741+0000 7f3bb29ca8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:11.752 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:11.741+0000 7f3bb29ca8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:11.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T08:38:11.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:38:11.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T08:38:11.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:38:11.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:38:11.928 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:11.929 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:38:11.929 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:38:11.930 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:11.930 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:38:12.126 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:13.128 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:13.128 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:13.129 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:38:13.129 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:38:13.129 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:13.130 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:38:13.328 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:13.492 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:13.481+0000 7f3bb29ca8c0 -1 Falling back to public interface 2026-02-17T08:38:14.330 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:14.330 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:14.330 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:38:14.331 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:38:14.331 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:14.331 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:38:14.520 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:15.522 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:15.522 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:15.522 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:38:15.522 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:38:15.523 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:15.523 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:38:15.716 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:16.478 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:16.469+0000 7f3bb29ca8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:38:16.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:16.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:16.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:38:16.719 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:38:16.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:16.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:38:16.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:17.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:17.919 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:17.919 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:38:17.920 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:38:17.920 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:17.920 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T08:38:18.112 INFO:tasks.workunit.client.0.trial059.stdout:osd.0 up in weight 1 up_from 6 up_thru 6 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3929063224,v1:127.0.0.1:6803/3929063224] [v2:127.0.0.1:6804/3929063224,v1:127.0.0.1:6805/3929063224] exists,up 33775f28-2d0f-4234-8af8-460814edcb31 2026-02-17T08:38:18.112 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:38:18.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:38:18.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:38:18.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:38:18.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 1 2026-02-17T08:38:18.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:38:18.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:38:18.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T08:38:18.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:38:18.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/1 2026-02-17T08:38:18.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:38:18.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:38:18.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:38:18.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:38:18.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/1' 2026-02-17T08:38:18.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/1/journal' 2026-02-17T08:38:18.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:38:18.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:38:18.113 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:38:18.113 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:38:18.113 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:38:18.113 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:38:18.114 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:38:18.114 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:38:18.114 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:38:18.114 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:38:18.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:38:18.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:38:18.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:38:18.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:38:18.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:38:18.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:38:18.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:38:18.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:38:18.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:38:18.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:38:18.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:38:18.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:38:18.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/1 2026-02-17T08:38:18.115 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:38:18.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=9c369dd2-6a41-4dac-a110-b409ee52b7a3 2026-02-17T08:38:18.117 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 9c369dd2-6a41-4dac-a110-b409ee52b7a3' 2026-02-17T08:38:18.117 INFO:tasks.workunit.client.0.trial059.stdout:add osd1 9c369dd2-6a41-4dac-a110-b409ee52b7a3 2026-02-17T08:38:18.117 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:38:18.129 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQD6KJRpE6spBxAAzIrKWgb6gkxqjzdEGA5+7Q== 2026-02-17T08:38:18.129 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQD6KJRpE6spBxAAzIrKWgb6gkxqjzdEGA5+7Q=="}' 2026-02-17T08:38:18.129 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 9c369dd2-6a41-4dac-a110-b409ee52b7a3 -i td/test-erasure-eio/1/new.json 2026-02-17T08:38:18.333 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:38:18.343 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/1/new.json 2026-02-17T08:38:18.343 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD6KJRpE6spBxAAzIrKWgb6gkxqjzdEGA5+7Q== --osd-uuid 9c369dd2-6a41-4dac-a110-b409ee52b7a3 2026-02-17T08:38:18.360 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:18.349+0000 7fdc01e958c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:18.361 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:18.349+0000 7fdc01e958c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:18.362 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:18.353+0000 7fdc01e958c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:18.363 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:18.353+0000 7fdc01e958c0 -1 bdev(0x5607d3f85c00 td/test-erasure-eio/1/block) open stat got: (1) Operation not permitted 2026-02-17T08:38:18.363 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:18.353+0000 7fdc01e958c0 -1 bluestore(td/test-erasure-eio/1) _read_fsid unparsable uuid 2026-02-17T08:38:20.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/1/keyring 2026-02-17T08:38:20.648 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:38:20.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T08:38:20.649 INFO:tasks.workunit.client.0.trial059.stdout:adding osd1 key to auth repository 2026-02-17T08:38:20.649 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:38:20.921 INFO:tasks.workunit.client.0.trial059.stdout:start osd.1 2026-02-17T08:38:20.921 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T08:38:20.921 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/1 --osd-journal=td/test-erasure-eio/1/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:38:20.922 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:38:20.922 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:38:20.922 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:38:20.945 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:20.933+0000 7fc6c7cc08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:20.946 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:20.937+0000 7fc6c7cc08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:20.947 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:20.937+0000 7fc6c7cc08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:21.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T08:38:21.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:38:21.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T08:38:21.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:38:21.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:38:21.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:21.122 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:38:21.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:38:21.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:21.122 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:38:21.323 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:22.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:22.325 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:22.325 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:38:22.326 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:38:22.326 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:22.326 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:38:22.467 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:22.457+0000 7fc6c7cc08c0 -1 Falling back to public interface 2026-02-17T08:38:22.521 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:23.522 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:23.522 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:23.523 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:38:23.523 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:38:23.523 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:23.523 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:38:23.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:24.719 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:24.720 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:24.720 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:38:24.720 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:38:24.720 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:24.720 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:38:24.916 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:25.711 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:25.701+0000 7fc6c7cc08c0 -1 osd.1 0 log_to_monitors true 2026-02-17T08:38:25.917 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:25.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:25.918 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:38:25.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:38:25.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:25.918 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:38:26.114 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:27.115 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:27.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:27.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:38:27.116 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:38:27.116 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:27.117 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T08:38:27.308 INFO:tasks.workunit.client.0.trial059.stdout:osd.1 up in weight 1 up_from 13 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3971446624,v1:127.0.0.1:6811/3971446624] [v2:127.0.0.1:6812/3971446624,v1:127.0.0.1:6813/3971446624] exists,up 9c369dd2-6a41-4dac-a110-b409ee52b7a3 2026-02-17T08:38:27.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:38:27.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:38:27.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:38:27.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:38:27.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 2 2026-02-17T08:38:27.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:38:27.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:38:27.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T08:38:27.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:38:27.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/2 2026-02-17T08:38:27.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:38:27.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:38:27.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:38:27.309 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:38:27.310 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-17T08:38:27.310 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-17T08:38:27.310 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:38:27.310 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:38:27.310 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:38:27.310 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:38:27.310 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:38:27.310 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:38:27.310 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:38:27.311 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:38:27.311 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:38:27.311 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:38:27.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:38:27.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:38:27.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:38:27.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:38:27.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:38:27.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:38:27.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:38:27.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:38:27.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:38:27.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:38:27.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:38:27.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:38:27.311 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/2 2026-02-17T08:38:27.312 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:38:27.313 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=6810a7ce-3e49-4759-bb7c-4f25c8c8a5ed 2026-02-17T08:38:27.313 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 6810a7ce-3e49-4759-bb7c-4f25c8c8a5ed' 2026-02-17T08:38:27.313 INFO:tasks.workunit.client.0.trial059.stdout:add osd2 6810a7ce-3e49-4759-bb7c-4f25c8c8a5ed 2026-02-17T08:38:27.314 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:38:27.326 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQADKZRpNVDmEhAAdBS8A3gdZcxQc+Y+Au8wpw== 2026-02-17T08:38:27.326 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQADKZRpNVDmEhAAdBS8A3gdZcxQc+Y+Au8wpw=="}' 2026-02-17T08:38:27.326 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 6810a7ce-3e49-4759-bb7c-4f25c8c8a5ed -i td/test-erasure-eio/2/new.json 2026-02-17T08:38:27.524 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:38:27.533 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/2/new.json 2026-02-17T08:38:27.534 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQADKZRpNVDmEhAAdBS8A3gdZcxQc+Y+Au8wpw== --osd-uuid 6810a7ce-3e49-4759-bb7c-4f25c8c8a5ed 2026-02-17T08:38:27.550 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:27.541+0000 7f58fe2cc8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:27.551 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:27.541+0000 7f58fe2cc8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:27.552 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:27.541+0000 7f58fe2cc8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:27.553 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:27.541+0000 7f58fe2cc8c0 -1 bdev(0x55a7c1369c00 td/test-erasure-eio/2/block) open stat got: (1) Operation not permitted 2026-02-17T08:38:27.553 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:27.541+0000 7f58fe2cc8c0 -1 bluestore(td/test-erasure-eio/2) _read_fsid unparsable uuid 2026-02-17T08:38:29.825 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/2/keyring 2026-02-17T08:38:29.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:38:29.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T08:38:29.827 INFO:tasks.workunit.client.0.trial059.stdout:adding osd2 key to auth repository 2026-02-17T08:38:29.827 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:38:30.091 INFO:tasks.workunit.client.0.trial059.stdout:start osd.2 2026-02-17T08:38:30.092 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T08:38:30.092 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:38:30.092 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:38:30.092 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:38:30.092 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:38:30.115 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:30.105+0000 7fa4543cd8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:30.117 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:30.105+0000 7fa4543cd8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:30.118 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:30.109+0000 7fa4543cd8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:30.291 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T08:38:30.291 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:38:30.291 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:38:30.291 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:38:30.291 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:38:30.291 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:30.291 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:38:30.291 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:38:30.291 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:30.292 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:38:30.489 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:31.491 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:31.492 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:31.492 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:38:31.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:38:31.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:31.494 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:38:31.599 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:31.589+0000 7fa4543cd8c0 -1 Falling back to public interface 2026-02-17T08:38:31.684 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:32.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:32.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:32.686 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:38:32.687 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:38:32.687 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:32.687 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:38:32.880 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:33.882 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:33.882 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:33.882 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:38:33.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:38:33.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:33.883 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:38:34.078 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:34.611 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:34.601+0000 7fa4543cd8c0 -1 osd.2 0 log_to_monitors true 2026-02-17T08:38:35.079 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:35.079 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:35.079 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:38:35.079 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:38:35.080 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:35.080 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:38:35.279 INFO:tasks.workunit.client.0.trial059.stdout:osd.2 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3500970807,v1:127.0.0.1:6819/3500970807] [v2:127.0.0.1:6820/3500970807,v1:127.0.0.1:6821/3500970807] exists,up 6810a7ce-3e49-4759-bb7c-4f25c8c8a5ed 2026-02-17T08:38:35.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:38:35.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:38:35.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:38:35.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:50: setup_osds: for id in $(seq 0 $(expr $count - 1)) 2026-02-17T08:38:35.280 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:51: setup_osds: run_osd td/test-erasure-eio 3 2026-02-17T08:38:35.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/test-erasure-eio 2026-02-17T08:38:35.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T08:38:35.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2026-02-17T08:38:35.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T08:38:35.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/test-erasure-eio/3 2026-02-17T08:38:35.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:38:35.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:38:35.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:38:35.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:38:35.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/test-erasure-eio/3' 2026-02-17T08:38:35.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/3/journal' 2026-02-17T08:38:35.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T08:38:35.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T08:38:35.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:38:35.282 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T08:38:35.282 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:38:35.282 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:38:35.282 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:38:35.282 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:38:35.282 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:38:35.282 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:38:35.282 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:38:35.282 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:38:35.282 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T08:38:35.283 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T08:38:35.283 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:38:35.283 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:38:35.283 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:38:35.283 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:38:35.283 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:38:35.283 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:38:35.283 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T08:38:35.283 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T08:38:35.283 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/test-erasure-eio/3 2026-02-17T08:38:35.283 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T08:38:35.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=598ed3b3-cd68-4a3b-874d-03c7c4be76ae 2026-02-17T08:38:35.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 598ed3b3-cd68-4a3b-874d-03c7c4be76ae' 2026-02-17T08:38:35.284 INFO:tasks.workunit.client.0.trial059.stdout:add osd3 598ed3b3-cd68-4a3b-874d-03c7c4be76ae 2026-02-17T08:38:35.284 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T08:38:35.296 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQALKZRpYNAcERAA74RzR5ncEXD8NJ86II+ytg== 2026-02-17T08:38:35.296 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQALKZRpYNAcERAA74RzR5ncEXD8NJ86II+ytg=="}' 2026-02-17T08:38:35.296 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 598ed3b3-cd68-4a3b-874d-03c7c4be76ae -i td/test-erasure-eio/3/new.json 2026-02-17T08:38:35.511 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:38:35.522 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/test-erasure-eio/3/new.json 2026-02-17T08:38:35.523 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQALKZRpYNAcERAA74RzR5ncEXD8NJ86II+ytg== --osd-uuid 598ed3b3-cd68-4a3b-874d-03c7c4be76ae 2026-02-17T08:38:35.546 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:35.537+0000 7fd6b06828c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:35.548 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:35.537+0000 7fd6b06828c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:35.549 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:35.537+0000 7fd6b06828c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:35.549 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:35.537+0000 7fd6b06828c0 -1 bdev(0x5638cc115c00 td/test-erasure-eio/3/block) open stat got: (1) Operation not permitted 2026-02-17T08:38:35.549 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:35.537+0000 7fd6b06828c0 -1 bluestore(td/test-erasure-eio/3) _read_fsid unparsable uuid 2026-02-17T08:38:37.832 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/test-erasure-eio/3/keyring 2026-02-17T08:38:37.832 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T08:38:37.833 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2026-02-17T08:38:37.833 INFO:tasks.workunit.client.0.trial059.stdout:adding osd3 key to auth repository 2026-02-17T08:38:37.834 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/test-erasure-eio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T08:38:38.103 INFO:tasks.workunit.client.0.trial059.stdout:start osd.3 2026-02-17T08:38:38.103 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2026-02-17T08:38:38.104 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/3 --osd-journal=td/test-erasure-eio/3/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:38:38.104 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T08:38:38.104 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T08:38:38.104 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T08:38:38.119 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:38.109+0000 7fbe07d698c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:38.120 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:38.109+0000 7fbe07d698c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:38.121 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:38.109+0000 7fbe07d698c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:38.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2026-02-17T08:38:38.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:38:38.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T08:38:38.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:38:38.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:38:38.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:38.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:38:38.300 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:38:38.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:38.300 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:38:38.496 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:39.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:39.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:39.498 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:38:39.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:38:39.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:39.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:38:39.607 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:39.597+0000 7fbe07d698c0 -1 Falling back to public interface 2026-02-17T08:38:39.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:40.698 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:40.698 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:40.698 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:38:40.699 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:38:40.699 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:40.699 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:38:40.892 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:41.893 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:41.894 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:41.894 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:38:41.895 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:38:41.895 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:41.895 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:38:42.089 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:42.845 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:42.833+0000 7fbe07d698c0 -1 osd.3 0 log_to_monitors true 2026-02-17T08:38:43.091 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:43.091 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:43.091 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:38:43.092 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:38:43.092 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:43.092 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:38:43.288 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:44.289 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:44.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:44.290 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T08:38:44.290 INFO:tasks.workunit.client.0.trial059.stdout:5 2026-02-17T08:38:44.291 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:44.291 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T08:38:44.485 INFO:tasks.workunit.client.0.trial059.stdout:osd.3 up in weight 1 up_from 26 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2771279774,v1:127.0.0.1:6827/2771279774] [v2:127.0.0.1:6828/2771279774,v1:127.0.0.1:6829/2771279774] exists,up 598ed3b3-cd68-4a3b-874d-03c7c4be76ae 2026-02-17T08:38:44.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:38:44.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:38:44.486 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:38:44.486 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: get_asok_path osd.0 2026-02-17T08:38:44.486 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T08:38:44.486 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T08:38:44.487 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:38:44.487 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:38:44.487 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:38:44.487 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.0.asok 2026-02-17T08:38:44.487 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: CEPH_ARGS= 2026-02-17T08:38:44.487 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:55: setup_osds: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.0.asok log flush 2026-02-17T08:38:44.547 INFO:tasks.workunit.client.0.trial059.stdout:{} 2026-02-17T08:38:44.552 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:56: setup_osds: grep 'load: jerasure.*lrc' td/test-erasure-eio/osd.0.log 2026-02-17T08:38:44.554 INFO:tasks.workunit.client.0.trial059.stdout:2026-02-17T08:38:13.485+0000 7f3bb29ca8c0 0 load: jerasure load: lrc 2026-02-17T08:38:44.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:349: TEST_rados_get_with_subreadall_eio_shard_1: local poolname=pool-jerasure 2026-02-17T08:38:44.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:350: TEST_rados_get_with_subreadall_eio_shard_1: create_erasure_coded_pool pool-jerasure 2 1 2026-02-17T08:38:44.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:67: create_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:38:44.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:68: create_erasure_coded_pool: shift 2026-02-17T08:38:44.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:69: create_erasure_coded_pool: local k=2 2026-02-17T08:38:44.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:70: create_erasure_coded_pool: shift 2026-02-17T08:38:44.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:71: create_erasure_coded_pool: local m=1 2026-02-17T08:38:44.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:72: create_erasure_coded_pool: shift 2026-02-17T08:38:44.555 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:74: create_erasure_coded_pool: ceph osd erasure-code-profile set myprofile plugin=jerasure k=2 m=1 crush-failure-domain=osd 2026-02-17T08:38:44.804 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:78: create_erasure_coded_pool: create_pool pool-jerasure 1 1 erasure myprofile 2026-02-17T08:38:44.804 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create pool-jerasure 1 1 erasure myprofile 2026-02-17T08:38:45.096 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' already exists 2026-02-17T08:38:45.105 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T08:38:46.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:80: create_erasure_coded_pool: wait_for_clean 2026-02-17T08:38:46.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:38:46.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:38:46.107 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:38:46.108 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:38:46.108 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:38:46.108 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:38:46.109 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:38:46.109 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:38:46.109 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:38:46.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:38:46.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:38:46.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:38:46.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:38:46.213 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:38:46.214 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:38:46.415 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:38:46.415 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:38:46.415 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:38:46.415 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:38:46.416 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:38:46.416 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:38:46.416 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:38:46.491 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803784 2026-02-17T08:38:46.491 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803784 2026-02-17T08:38:46.491 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803784' 2026-02-17T08:38:46.491 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:38:46.491 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:38:46.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=55834574854 2026-02-17T08:38:46.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 55834574854 2026-02-17T08:38:46.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803784 1-55834574854' 2026-02-17T08:38:46.568 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:38:46.568 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:38:46.641 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=77309411333 2026-02-17T08:38:46.642 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 77309411333 2026-02-17T08:38:46.642 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803784 1-55834574854 2-77309411333' 2026-02-17T08:38:46.642 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:38:46.642 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:38:46.716 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=111669149699 2026-02-17T08:38:46.716 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 111669149699 2026-02-17T08:38:46.716 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803784 1-55834574854 2-77309411333 3-111669149699' 2026-02-17T08:38:46.716 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:38:46.717 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803784 2026-02-17T08:38:46.717 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:38:46.718 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:38:46.719 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803784 2026-02-17T08:38:46.719 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:38:46.720 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803784 2026-02-17T08:38:46.720 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803784' 2026-02-17T08:38:46.721 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 25769803784 2026-02-17T08:38:46.721 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:38:46.924 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803782 -lt 25769803784 2026-02-17T08:38:46.924 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:38:47.925 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:38:47.926 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:38:48.128 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803785 -lt 25769803784 2026-02-17T08:38:48.128 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:38:48.128 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-55834574854 2026-02-17T08:38:48.129 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:38:48.130 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:38:48.130 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-55834574854 2026-02-17T08:38:48.131 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:38:48.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=55834574854 2026-02-17T08:38:48.132 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 55834574854' 2026-02-17T08:38:48.133 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 55834574854 2026-02-17T08:38:48.133 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:38:48.335 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 55834574855 -lt 55834574854 2026-02-17T08:38:48.335 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:38:48.336 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-77309411333 2026-02-17T08:38:48.336 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:38:48.337 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:38:48.338 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-77309411333 2026-02-17T08:38:48.338 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:38:48.339 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=77309411333 2026-02-17T08:38:48.340 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 77309411333 2026-02-17T08:38:48.340 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 77309411333' 2026-02-17T08:38:48.340 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:38:48.541 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 77309411333 -lt 77309411333 2026-02-17T08:38:48.541 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:38:48.542 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-111669149699 2026-02-17T08:38:48.542 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:38:48.543 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:38:48.544 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-111669149699 2026-02-17T08:38:48.544 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:38:48.545 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=111669149699 2026-02-17T08:38:48.546 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 111669149699 2026-02-17T08:38:48.546 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 111669149699' 2026-02-17T08:38:48.546 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:38:48.746 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 111669149699 -lt 111669149699 2026-02-17T08:38:48.747 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:38:48.747 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:38:48.747 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:38:48.999 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:38:49.000 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:38:49.000 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:38:49.000 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:38:49.000 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:38:49.000 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:38:49.000 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:38:49.001 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:38:49.187 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:38:49.188 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:38:49.188 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:38:49.188 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:38:49.450 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:38:49.450 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:38:49.450 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:38:49.450 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:352: TEST_rados_get_with_subreadall_eio_shard_1: rados_put_get_data eio td/test-erasure-eio 1 recovery 2026-02-17T08:38:49.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:147: rados_put_get_data: local inject=eio 2026-02-17T08:38:49.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:148: rados_put_get_data: shift 2026-02-17T08:38:49.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:149: rados_put_get_data: local dir=td/test-erasure-eio 2026-02-17T08:38:49.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:150: rados_put_get_data: shift 2026-02-17T08:38:49.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:151: rados_put_get_data: local shard_id=1 2026-02-17T08:38:49.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:152: rados_put_get_data: shift 2026-02-17T08:38:49.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:153: rados_put_get_data: local arg=recovery 2026-02-17T08:38:49.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:157: rados_put_get_data: local poolname=pool-jerasure 2026-02-17T08:38:49.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:158: rados_put_get_data: local objname=obj-eio-70936-1 2026-02-17T08:38:49.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:159: rados_put_get_data: rados_put td/test-erasure-eio pool-jerasure obj-eio-70936-1 2026-02-17T08:38:49.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:90: rados_put: local dir=td/test-erasure-eio 2026-02-17T08:38:49.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:91: rados_put: local poolname=pool-jerasure 2026-02-17T08:38:49.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:92: rados_put: local objname=obj-eio-70936-1 2026-02-17T08:38:49.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:38:49.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 AAA 2026-02-17T08:38:49.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:38:49.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 BBB 2026-02-17T08:38:49.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:38:49.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 CCCC 2026-02-17T08:38:49.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:94: rados_put: for marker in AAA BBB CCCC DDDD 2026-02-17T08:38:49.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:95: rados_put: printf '%*s' 1024 DDDD 2026-02-17T08:38:49.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:100: rados_put: rados --pool pool-jerasure put obj-eio-70936-1 td/test-erasure-eio/ORIGINAL 2026-02-17T08:38:49.468 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:160: rados_put_get_data: inject_eio ec data pool-jerasure obj-eio-70936-1 td/test-erasure-eio 1 2026-02-17T08:38:49.468 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2457: inject_eio: local pooltype=ec 2026-02-17T08:38:49.469 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2458: inject_eio: shift 2026-02-17T08:38:49.469 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2459: inject_eio: local which=data 2026-02-17T08:38:49.469 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2460: inject_eio: shift 2026-02-17T08:38:49.469 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2461: inject_eio: local poolname=pool-jerasure 2026-02-17T08:38:49.469 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2462: inject_eio: shift 2026-02-17T08:38:49.469 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2463: inject_eio: local objname=obj-eio-70936-1 2026-02-17T08:38:49.469 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2464: inject_eio: shift 2026-02-17T08:38:49.469 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2465: inject_eio: local dir=td/test-erasure-eio 2026-02-17T08:38:49.469 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2466: inject_eio: shift 2026-02-17T08:38:49.469 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2467: inject_eio: local shard_id=1 2026-02-17T08:38:49.469 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2468: inject_eio: shift 2026-02-17T08:38:49.469 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: get_osds pool-jerasure obj-eio-70936-1 2026-02-17T08:38:49.470 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:38:49.470 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj-eio-70936-1 2026-02-17T08:38:49.470 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj-eio-70936-1 2026-02-17T08:38:49.470 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:38:49.668 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:38:49.668 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:38:49.668 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:38:49.668 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 2 2026-02-17T08:38:49.669 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: initial_osds=('3' '1' '2') 2026-02-17T08:38:49.669 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: local -a initial_osds 2026-02-17T08:38:49.670 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2471: inject_eio: local osd_id=1 2026-02-17T08:38:49.670 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2472: inject_eio: '[' ec '!=' ec ']' 2026-02-17T08:38:49.670 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: cat td/test-erasure-eio/1/type 2026-02-17T08:38:49.671 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: type=bluestore 2026-02-17T08:38:49.671 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2476: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-17T08:38:49.671 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1161: set_config: local daemon=osd 2026-02-17T08:38:49.671 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1162: set_config: local id=1 2026-02-17T08:38:49.671 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1163: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T08:38:49.671 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1164: set_config: local value=true 2026-02-17T08:38:49.672 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: jq 'has("success")' 2026-02-17T08:38:49.673 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: get_asok_path osd.1 2026-02-17T08:38:49.673 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2026-02-17T08:38:49.673 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2026-02-17T08:38:49.673 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:38:49.673 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:38:49.673 INFO:tasks.workunit.client.0.trial059.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:38:49.673 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.1.asok 2026-02-17T08:38:49.673 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.70936/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-17T08:38:49.732 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: test true == true 2026-02-17T08:38:49.732 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2477: inject_eio: local loop=0 2026-02-17T08:38:49.733 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2479: inject_eio: grep -q Invalid 2026-02-17T08:38:49.733 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: get_asok_path osd.1 2026-02-17T08:38:49.733 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2026-02-17T08:38:49.733 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2026-02-17T08:38:49.734 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T08:38:49.734 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:38:49.735 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:38:49.735 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.70936/ceph-osd.1.asok 2026-02-17T08:38:49.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: CEPH_ARGS= 2026-02-17T08:38:49.735 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: ceph --admin-daemon /tmp/ceph-asok.70936/ceph-osd.1.asok injectdataerr pool-jerasure obj-eio-70936-1 1 2026-02-17T08:38:49.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:161: rados_put_get_data: rados_get td/test-erasure-eio pool-jerasure obj-eio-70936-1 2026-02-17T08:38:49.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:104: rados_get: local dir=td/test-erasure-eio 2026-02-17T08:38:49.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:105: rados_get: local poolname=pool-jerasure 2026-02-17T08:38:49.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:106: rados_get: local objname=obj-eio-70936-1 2026-02-17T08:38:49.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:107: rados_get: local expect=ok 2026-02-17T08:38:49.791 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:112: rados_get: '[' ok = fail ']' 2026-02-17T08:38:49.792 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:120: rados_get: rados --pool pool-jerasure get obj-eio-70936-1 td/test-erasure-eio/COPY 2026-02-17T08:38:49.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:121: rados_get: diff td/test-erasure-eio/ORIGINAL td/test-erasure-eio/COPY 2026-02-17T08:38:49.811 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:122: rados_get: rm td/test-erasure-eio/COPY 2026-02-17T08:38:49.813 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:163: rados_put_get_data: '[' recovery = recovery ']' 2026-02-17T08:38:49.813 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:170: rados_put_get_data: get_osds pool-jerasure obj-eio-70936-1 2026-02-17T08:38:49.814 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:38:49.814 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj-eio-70936-1 2026-02-17T08:38:49.814 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj-eio-70936-1 2026-02-17T08:38:49.814 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:38:50.017 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:38:50.017 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:38:50.017 INFO:tasks.workunit.client.0.trial059.stderr:2' 2026-02-17T08:38:50.017 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 2 2026-02-17T08:38:50.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:170: rados_put_get_data: initial_osds=('3' '1' '2') 2026-02-17T08:38:50.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:170: rados_put_get_data: local -a initial_osds 2026-02-17T08:38:50.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:171: rados_put_get_data: local last_osd=2 2026-02-17T08:38:50.017 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:173: rados_put_get_data: kill_daemons td/test-erasure-eio TERM osd.2 2026-02-17T08:38:50.018 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:38:50.018 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:38:50.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:38:50.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:38:50.018 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:38:51.328 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:38:51.329 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:174: rados_put_get_data: ceph osd out 2 2026-02-17T08:38:51.576 INFO:tasks.workunit.client.0.trial059.stderr:osd.2 is already out. 2026-02-17T08:38:51.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:175: rados_put_get_data: get_osds pool-jerasure obj-eio-70936-1 2026-02-17T08:38:51.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=pool-jerasure 2026-02-17T08:38:51.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=obj-eio-70936-1 2026-02-17T08:38:51.586 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:175: rados_put_get_data: grep '\<2\>' 2026-02-17T08:38:51.587 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map pool-jerasure obj-eio-70936-1 2026-02-17T08:38:51.587 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T08:38:51.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=3 2026-02-17T08:38:51.789 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:38:51.789 INFO:tasks.workunit.client.0.trial059.stderr:0' 2026-02-17T08:38:51.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 3 1 0 2026-02-17T08:38:51.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:176: rados_put_get_data: ceph osd in 2 2026-02-17T08:38:52.036 INFO:tasks.workunit.client.0.trial059.stderr:osd.2 is already in. 2026-02-17T08:38:52.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:177: rados_put_get_data: activate_osd td/test-erasure-eio 2 2026-02-17T08:38:52.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/test-erasure-eio 2026-02-17T08:38:52.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T08:38:52.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=2 2026-02-17T08:38:52.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T08:38:52.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/test-erasure-eio/2 2026-02-17T08:38:52.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true ' 2026-02-17T08:38:52.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T08:38:52.048 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T08:38:52.049 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T08:38:52.049 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/test-erasure-eio/2' 2026-02-17T08:38:52.049 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/test-erasure-eio/2/journal' 2026-02-17T08:38:52.049 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T08:38:52.049 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T08:38:52.049 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/test-erasure-eio' 2026-02-17T08:38:52.049 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T08:38:52.049 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T08:38:52.049 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T08:38:52.049 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T08:38:52.049 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:38:52.049 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:38:52.050 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:38:52.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' 2026-02-17T08:38:52.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T08:38:52.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/test-erasure-eio/$name.log' 2026-02-17T08:38:52.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/test-erasure-eio/$name.pid' 2026-02-17T08:38:52.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T08:38:52.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T08:38:52.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T08:38:52.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T08:38:52.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T08:38:52.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T08:38:52.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/test-erasure-eio/2 2026-02-17T08:38:52.051 INFO:tasks.workunit.client.0.trial059.stdout:start osd.2 2026-02-17T08:38:52.052 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.2 2026-02-17T08:38:52.052 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 2 --fsid=a02bc570-c133-49cd-9dce-1133b3ee2def --auth-supported=none --mon-host=127.0.0.1:7112 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/test-erasure-eio/2 --osd-journal=td/test-erasure-eio/2/journal --chdir= --run-dir=td/test-erasure-eio '--admin-socket=/tmp/ceph-asok.70936/$cluster-$name.asok' --debug-osd=20 '--log-file=td/test-erasure-eio/$name.log' '--pid-file=td/test-erasure-eio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T08:38:52.052 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/test-erasure-eio/2/whoami 2026-02-17T08:38:52.052 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 2 = 2 ']' 2026-02-17T08:38:52.052 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T08:38:52.053 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T08:38:52.053 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T08:38:52.071 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:52.061+0000 7fa0f727c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:52.072 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:52.061+0000 7fa0f727c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:52.073 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:52.061+0000 7fa0f727c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T08:38:52.249 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 2 2026-02-17T08:38:52.250 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T08:38:52.250 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T08:38:52.250 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T08:38:52.250 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T08:38:52.250 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:52.250 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T08:38:52.250 INFO:tasks.workunit.client.0.trial059.stdout:0 2026-02-17T08:38:52.250 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:52.250 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:38:52.449 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:53.304 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:53.293+0000 7fa0f727c8c0 -1 Falling back to public interface 2026-02-17T08:38:53.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:53.451 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:53.451 INFO:tasks.workunit.client.0.trial059.stdout:1 2026-02-17T08:38:53.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T08:38:53.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:53.452 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:38:53.650 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:54.651 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:54.652 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:54.652 INFO:tasks.workunit.client.0.trial059.stdout:2 2026-02-17T08:38:54.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T08:38:54.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:54.653 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:38:54.848 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:55.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:55.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:55.849 INFO:tasks.workunit.client.0.trial059.stdout:3 2026-02-17T08:38:55.849 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T08:38:55.850 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:55.850 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:38:56.047 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T08:38:56.549 INFO:tasks.workunit.client.0.trial059.stderr:2026-02-17T08:38:56.537+0000 7fa0f727c8c0 -1 osd.2 33 log_to_monitors true 2026-02-17T08:38:57.049 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T08:38:57.049 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T08:38:57.049 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T08:38:57.049 INFO:tasks.workunit.client.0.trial059.stdout:4 2026-02-17T08:38:57.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T08:38:57.050 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T08:38:57.248 INFO:tasks.workunit.client.0.trial059.stdout:osd.2 up in weight 1 up_from 42 up_thru 20 down_at 34 last_clean_interval [18,33) [v2:127.0.0.1:6818/262591225,v1:127.0.0.1:6819/262591225] [v2:127.0.0.1:6820/262591225,v1:127.0.0.1:6821/262591225] exists,up 6810a7ce-3e49-4759-bb7c-4f25c8c8a5ed 2026-02-17T08:38:57.250 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T08:38:57.250 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T08:38:57.250 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T08:38:57.250 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:178: rados_put_get_data: wait_for_clean 2026-02-17T08:38:57.250 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T08:38:57.250 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T08:38:57.251 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T08:38:57.251 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T08:38:57.251 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T08:38:57.251 INFO:tasks.workunit.client.0.trial059.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T08:38:57.251 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T08:38:57.251 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T08:38:57.251 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T08:38:57.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T08:38:57.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T08:38:57.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T08:38:57.360 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T08:38:57.361 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T08:38:57.361 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T08:38:57.565 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T08:38:57.565 INFO:tasks.workunit.client.0.trial059.stderr:1 2026-02-17T08:38:57.565 INFO:tasks.workunit.client.0.trial059.stderr:2 2026-02-17T08:38:57.565 INFO:tasks.workunit.client.0.trial059.stderr:3' 2026-02-17T08:38:57.566 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T08:38:57.566 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:38:57.566 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T08:38:57.640 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=25769803788 2026-02-17T08:38:57.640 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 25769803788 2026-02-17T08:38:57.640 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803788' 2026-02-17T08:38:57.640 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:38:57.641 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T08:38:57.716 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=55834574859 2026-02-17T08:38:57.716 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 55834574859 2026-02-17T08:38:57.716 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803788 1-55834574859' 2026-02-17T08:38:57.716 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:38:57.716 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T08:38:57.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=180388626435 2026-02-17T08:38:57.789 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 180388626435 2026-02-17T08:38:57.790 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803788 1-55834574859 2-180388626435' 2026-02-17T08:38:57.790 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T08:38:57.790 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T08:38:57.864 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=111669149703 2026-02-17T08:38:57.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 111669149703 2026-02-17T08:38:57.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-25769803788 1-55834574859 2-180388626435 3-111669149703' 2026-02-17T08:38:57.865 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:38:57.865 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-25769803788 2026-02-17T08:38:57.866 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:38:57.866 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T08:38:57.867 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-25769803788 2026-02-17T08:38:57.867 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:38:57.868 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=25769803788 2026-02-17T08:38:57.868 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.0 seq 25769803788 2026-02-17T08:38:57.869 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 25769803788' 2026-02-17T08:38:57.869 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T08:38:58.075 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 25769803789 -lt 25769803788 2026-02-17T08:38:58.075 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:38:58.076 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-55834574859 2026-02-17T08:38:58.076 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:38:58.077 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T08:38:58.077 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-55834574859 2026-02-17T08:38:58.078 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:38:58.079 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=55834574859 2026-02-17T08:38:58.079 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 55834574859' 2026-02-17T08:38:58.079 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.1 seq 55834574859 2026-02-17T08:38:58.080 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T08:38:58.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 55834574859 -lt 55834574859 2026-02-17T08:38:58.279 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:38:58.279 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-180388626435 2026-02-17T08:38:58.280 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:38:58.281 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T08:38:58.282 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-180388626435 2026-02-17T08:38:58.282 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:38:58.283 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=180388626435 2026-02-17T08:38:58.283 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.2 seq 180388626435 2026-02-17T08:38:58.284 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 180388626435' 2026-02-17T08:38:58.284 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T08:38:58.493 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 180388626435 -lt 180388626435 2026-02-17T08:38:58.494 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T08:38:58.494 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-111669149703 2026-02-17T08:38:58.494 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T08:38:58.495 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T08:38:58.496 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-111669149703 2026-02-17T08:38:58.496 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T08:38:58.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=111669149703 2026-02-17T08:38:58.498 INFO:tasks.workunit.client.0.trial059.stdout:waiting osd.3 seq 111669149703 2026-02-17T08:38:58.498 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 111669149703' 2026-02-17T08:38:58.498 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:38:58.695 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 111669149701 -lt 111669149703 2026-02-17T08:38:58.695 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T08:38:59.696 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T08:38:59.697 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T08:38:59.893 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 111669149704 -lt 111669149703 2026-02-17T08:38:59.894 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T08:38:59.894 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:38:59.895 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:39:00.152 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 == 0 2026-02-17T08:39:00.152 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T08:39:00.153 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T08:39:00.153 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T08:39:00.153 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T08:39:00.153 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T08:39:00.153 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T08:39:00.153 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T08:39:00.344 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=5 2026-02-17T08:39:00.345 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T08:39:00.345 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T08:39:00.345 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T08:39:00.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 5 = 5 2026-02-17T08:39:00.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T08:39:00.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T08:39:00.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:354: TEST_rados_get_with_subreadall_eio_shard_1: delete_erasure_coded_pool pool-jerasure 2026-02-17T08:39:00.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:84: delete_erasure_coded_pool: local poolname=pool-jerasure 2026-02-17T08:39:00.606 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:85: delete_erasure_coded_pool: ceph osd pool delete pool-jerasure pool-jerasure --yes-i-really-really-mean-it 2026-02-17T08:39:00.816 INFO:tasks.workunit.client.0.trial059.stderr:pool 'pool-jerasure' does not exist 2026-02-17T08:39:00.826 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:86: delete_erasure_coded_pool: ceph osd erasure-code-profile rm myprofile 2026-02-17T08:39:01.076 INFO:tasks.workunit.client.0.trial059.stderr:erasure-code-profile myprofile does not exist 2026-02-17T08:39:01.085 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh:42: run: teardown td/test-erasure-eio 2026-02-17T08:39:01.085 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:39:01.085 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T08:39:01.086 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:39:01.086 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:39:01.086 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:39:01.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:39:01.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:39:01.087 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:39:01.398 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:39:01.399 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:39:01.400 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:39:01.401 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:39:01.402 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:39:01.403 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:39:01.403 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:39:01.404 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:39:01.404 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:39:01.405 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:39:01.405 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:39:01.406 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:39:01.407 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T08:39:01.407 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:39:01.422 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:39:01.422 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:39:01.422 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:39:01.422 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:39:01.424 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:39:01.424 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:39:01.424 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: main: code=0 2026-02-17T08:39:01.424 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: main: teardown td/test-erasure-eio 0 2026-02-17T08:39:01.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/test-erasure-eio 2026-02-17T08:39:01.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2026-02-17T08:39:01.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/test-erasure-eio KILL 2026-02-17T08:39:01.425 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T08:39:01.425 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T08:39:01.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T08:39:01.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T08:39:01.425 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T08:39:01.427 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T08:39:01.427 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T08:39:01.428 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T08:39:01.429 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T08:39:01.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T08:39:01.430 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T08:39:01.431 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T08:39:01.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:39:01.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T08:39:01.432 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T08:39:01.433 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:39:01.434 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:39:01.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T08:39:01.435 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/test-erasure-eio 2026-02-17T08:39:01.437 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T08:39:01.437 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T08:39:01.437 INFO:tasks.workunit.client.0.trial059.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.70936 2026-02-17T08:39:01.437 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.70936 2026-02-17T08:39:01.438 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T08:39:01.439 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T08:39:01.439 INFO:tasks.workunit.client.0.trial059.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: main: return 0 2026-02-17T08:39:01.440 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T08:39:01.440 DEBUG:teuthology.orchestra.run.trial059:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T08:39:01.449 INFO:tasks.workunit:Stopping ['erasure-code'] on client.0... 2026-02-17T08:39:01.449 DEBUG:teuthology.orchestra.run.trial059:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-17T08:39:01.788 DEBUG:teuthology.parallel:result is None 2026-02-17T08:39:01.788 DEBUG:teuthology.orchestra.run.trial059:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T08:39:01.796 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T08:39:01.796 DEBUG:teuthology.orchestra.run.trial059:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-17T08:39:01.842 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T08:39:01.842 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T08:39:01.856 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T08:39:01.856 DEBUG:teuthology.orchestra.run.trial059:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T08:39:01.979 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T08:39:01.990 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T08:39:01.990 DEBUG:teuthology.orchestra.run.trial059:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T08:39:02.050 INFO:teuthology.orchestra.run.trial059.stdout: remote refid st t when poll reach delay offset jitter 2026-02-17T08:39:02.050 INFO:teuthology.orchestra.run.trial059.stdout:============================================================================== 2026-02-17T08:39:02.050 INFO:teuthology.orchestra.run.trial059.stdout:-172-233-155-39. 40.119.6.228 4 u 64 64 377 66.957 +15.625 5.634 2026-02-17T08:39:02.050 INFO:teuthology.orchestra.run.trial059.stdout:+time.walb.tech 50.117.3.95 3 u 53 64 377 3.497 +8.699 5.785 2026-02-17T08:39:02.050 INFO:teuthology.orchestra.run.trial059.stdout:+23.186.168.129 132.163.97.4 2 u 65 64 357 69.682 +9.643 6.545 2026-02-17T08:39:02.050 INFO:teuthology.orchestra.run.trial059.stdout:*time.meme.holdi 209.195.0.250 2 u 58 64 377 19.756 +9.737 3.357 2026-02-17T08:39:02.050 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T08:39:02.063 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T08:39:02.063 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T08:39:02.077 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T08:39:02.092 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T08:39:02.107 INFO:teuthology.task.internal:Duration was 1725.153668 seconds 2026-02-17T08:39:02.108 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T08:39:02.129 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T08:39:02.129 DEBUG:teuthology.orchestra.run.trial059:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T08:39:02.154 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T08:39:02.154 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial059.front.sepia.ceph.com 2026-02-17T08:39:02.154 DEBUG:teuthology.orchestra.run.trial059:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T08:39:02.203 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T08:39:02.204 DEBUG:teuthology.orchestra.run.trial059:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T08:39:02.400 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T08:39:02.401 DEBUG:teuthology.orchestra.run.trial059:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T08:39:02.410 INFO:teuthology.orchestra.run.trial059.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T08:39:02.410 INFO:teuthology.orchestra.run.trial059.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T08:39:02.412 INFO:teuthology.orchestra.run.trial059.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T08:39:02.412 INFO:teuthology.orchestra.run.trial059.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T08:39:02.412 INFO:teuthology.orchestra.run.trial059.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T08:39:02.458 INFO:teuthology.orchestra.run.trial059.stderr: 81.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T08:39:02.460 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T08:39:02.476 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T08:39:02.476 DEBUG:teuthology.orchestra.run.trial059:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T08:39:02.510 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T08:39:02.529 DEBUG:teuthology.orchestra.run.trial059:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:39:02.561 INFO:teuthology.orchestra.run.trial059.stdout:kernel.core_pattern = core 2026-02-17T08:39:02.571 DEBUG:teuthology.orchestra.run.trial059:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:39:02.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:39:02.617 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T08:39:02.639 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T08:39:02.641 DEBUG:teuthology.misc:Transferring archived files from trial059:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51105/remote/trial059 2026-02-17T08:39:02.643 DEBUG:teuthology.orchestra.run.trial059:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T08:39:02.694 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T08:39:02.694 DEBUG:teuthology.orchestra.run.trial059:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T08:39:02.726 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T08:39:02.744 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T08:39:02.744 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T08:39:02.765 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T08:39:02.766 DEBUG:teuthology.orchestra.run.trial059:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T08:39:02.774 INFO:teuthology.orchestra.run.trial059.stdout: 1180192 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 08:39 /home/ubuntu/cephtest 2026-02-17T08:39:02.776 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T08:39:02.793 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T08:39:02.831 INFO:teuthology.run:Summary data: description: rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} duration: 1725.1536684036255 flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com success: true 2026-02-17T08:39:02.831 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:39:02.948 INFO:teuthology.run:pass